Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw to ip-10-0-134-155.ec2.internal

ai-tenants

e2e-api-a-9883e4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-9883e4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-0fc77f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-0fc77f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-9154a6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-9154a6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-a43a70

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-a43a70: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-7229f2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-7229f2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-99ca0c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-99ca0c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-401761

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-401761: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-47c409

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-47c409: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-654741

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-654741: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-8973e2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-8973e2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-afc519

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-afc519: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-227c93

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-227c93: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-567ca6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-567ca6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-a04e4e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-a04e4e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-a99f2a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-a99f2a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-ded435

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-ded435: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-04d111

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-04d111: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-108ad8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-108ad8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-171edd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-171edd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-1daf30

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-1daf30: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-670795

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-670795: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-12c0bc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-12c0bc: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-47e9af

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-47e9af: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-829ac7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-829ac7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-c1fe26

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-c1fe26: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-fb346b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-fb346b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-3430f6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-3430f6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-ceba51

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-ceba51: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-f91cd1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-f91cd1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-ff43e3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-ff43e3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-24cd29

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-24cd29: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-7b4185

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-7b4185: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-a9b573

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-a9b573: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-b8bb1e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-b8bb1e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-146320d5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-146320d5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-51cc4ce6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-51cc4ce6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-9ee727

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-9ee727: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-b3ca79

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-b3ca79: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-c6859a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-c6859a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-d1d441

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-d1d441: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-e37d27

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-e37d27: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-7cf9ef

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-7cf9ef: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-81c810

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-81c810: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-b44631

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-b44631: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-e6a0de

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-e6a0de: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-edc450

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-edc450: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-766728

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-766728: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-77a153

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-77a153: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-c9707f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-c9707f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-338f2e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-338f2e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-57dc6d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-57dc6d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-25f56e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-25f56e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-d6ac82

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-d6ac82: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-031745

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-031745: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-b2a372

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-b2a372: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-9633f0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-9633f0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-965f61

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-965f61: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-439989

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-439989: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-09a20a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-09a20a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-4c2387

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-4c2387: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-c4006d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-c4006d: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-b5jf6

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-b5jf6 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7b4185-cfcb87d66-l8fzb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7b4185-cfcb87d66-l8fzb to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a9b573-6c5c49445d-j6qkq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a9b573-6c5c49445d-j6qkq to ip-10-0-134-155.ec2.internal

opendatahub

test-curl-7102-0c87d7

Scheduled

Successfully assigned opendatahub/test-curl-7102-0c87d7 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a9b573-85d444bfdf-zzqlp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a9b573-85d444bfdf-zzqlp to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b8bb1e-6d9649764-p2b84

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b8bb1e-6d9649764-p2b84 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b8bb1e-84466f94c-pjkmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b8bb1e-84466f94c-pjkmm to ip-10-0-134-155.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-rcj64

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-rcj64 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-24cd29-69d9789c79-fh6c4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-24cd29-69d9789c79-fh6c4 to ip-10-0-130-57.ec2.internal

opendatahub

test-curl-7099-0a9981

Scheduled

Successfully assigned opendatahub/test-curl-7099-0a9981 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-chxzf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-chxzf to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-ff43e3-944445948-ph2kl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ff43e3-944445948-ph2kl to ip-10-0-130-57.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7wbkm to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq to ip-10-0-134-155.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-6wsnk

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-6wsnk to ip-10-0-140-110.ec2.internal

opendatahub

test-curl-7096-f899c2

Scheduled

Successfully assigned opendatahub/test-curl-7096-f899c2 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd to ip-10-0-130-57.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-fnhnx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-fnhnx to ip-10-0-130-57.ec2.internal

opendatahub

test-curl-7102-606b8f

Scheduled

Successfully assigned opendatahub/test-curl-7102-606b8f to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-mt-146320d5-586748b797-4lhzm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-146320d5-586748b797-4lhzm to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl to ip-10-0-134-155.ec2.internal

opendatahub

test-curl-7096-c7f796

Scheduled

Successfully assigned opendatahub/test-curl-7096-c7f796 to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w to ip-10-0-140-110.ec2.internal

kuadrant-system

authorino-5698fc8df4-kqgsq

Scheduled

Successfully assigned kuadrant-system/authorino-5698fc8df4-kqgsq to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj to ip-10-0-140-110.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-mgrwq

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-mgrwq to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn to ip-10-0-134-155.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-bvgmx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-bvgmx to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm to ip-10-0-134-155.ec2.internal

kuadrant-system

authorino-57f7f8659f-z7gvh

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-z7gvh to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm to ip-10-0-134-155.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-zzvpx

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zzvpx to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n to ip-10-0-130-57.ec2.internal

opendatahub

test-curl-7096-a211b5

Scheduled

Successfully assigned opendatahub/test-curl-7096-a211b5 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-16cda44a-openshift-default-778c87d957-665xc to ip-10-0-134-155.ec2.internal

kuadrant-system

authorino-6889cbd8c4-lthv8

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-lthv8 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb to ip-10-0-130-57.ec2.internal

kuadrant-system

authorino-6f6944bcdd-9wgm4

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-9wgm4 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x to ip-10-0-134-155.ec2.internal

kuadrant-system

authorino-77ddb887cc-6csbj

Scheduled

Successfully assigned kuadrant-system/authorino-77ddb887cc-6csbj to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-ss4kp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-ss4kp to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-vk52b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-vk52b to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-4m89w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-4m89w to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv to ip-10-0-130-57.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-r22dt

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-r22dt to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-mt-146320d5-586748b797-k74kx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-146320d5-586748b797-k74kx to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp to ip-10-0-130-57.ec2.internal

opendatahub

test-curl-7096-024b07

Scheduled

Successfully assigned opendatahub/test-curl-7096-024b07 to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

Scheduled

Successfully assigned openshift-ingress/e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

Scheduled

Successfully assigned openshift-ingress/e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92 to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr to ip-10-0-130-57.ec2.internal

opendatahub

odh-model-controller-769875db56-5qwzx

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-5qwzx to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

Scheduled

Successfully assigned openshift-ingress/e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr to ip-10-0-130-57.ec2.internal

opendatahub

test-curl-7108-0d3be9

Scheduled

Successfully assigned opendatahub/test-curl-7108-0d3be9 to ip-10-0-134-155.ec2.internal

ai-tenants

e2e-api-a-801218

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-801218: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-gz8bs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-gz8bs to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-ttklw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-ttklw to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-qfvwr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-qfvwr to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-b2hdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-b2hdr to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-jjpxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-jjpxl to ip-10-0-134-155.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-ggcnf

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-ggcnf to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-ff43e3-576df466d7-4pqsr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ff43e3-576df466d7-4pqsr to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-h696c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-h696c to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-x47zn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-x47zn to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-nbdsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-nbdsj to ip-10-0-134-155.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-9mrkv

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-9mrkv to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-ceba51-9776c4ffb-vddkl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ceba51-9776c4ffb-vddkl to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf to ip-10-0-134-155.ec2.internal

opendatahub

test-curl-7108-535368

Scheduled

Successfully assigned opendatahub/test-curl-7108-535368 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm to ip-10-0-130-57.ec2.internal

openshift-ingress

kube-auth-proxy-58666cb9df-892tn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-58666cb9df-892tn to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-mt-51cc4ce6-68c544d767-fgsbv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-51cc4ce6-68c544d767-fgsbv to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-r5j4l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-r5j4l to ip-10-0-130-57.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-sqjb4

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-sqjb4 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-8f4k2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-8f4k2 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-gmshg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-gmshg to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-gb52r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-gb52r to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-srt2f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-srt2f to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-81c810-5749ff85ff-5fr52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-81c810-5749ff85ff-5fr52 to ip-10-0-134-155.ec2.internal

opendatahub

maas-controller-85c4f7957c-rzwcg

Scheduled

Successfully assigned opendatahub/maas-controller-85c4f7957c-rzwcg to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-b44631-8456d66fbf-kb6zn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b44631-8456d66fbf-kb6zn to ip-10-0-130-57.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-cljqx

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-cljqx to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942 to ip-10-0-130-57.ec2.internal

opendatahub

maas-controller-85c4f7957c-mh7qn

Scheduled

Successfully assigned opendatahub/maas-controller-85c4f7957c-mh7qn to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-qqgln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-qqgln to ip-10-0-134-155.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68dd7b898flnvv2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68dd7b898flnvv2 to ip-10-0-130-57.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-vwcwp

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-vwcwp to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-edc450-8c5754587-sfsfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-edc450-8c5754587-sfsfv to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9 to ip-10-0-134-155.ec2.internal

opendatahub

maas-controller-85c4f7957c-jtbfr

Scheduled

Successfully assigned opendatahub/maas-controller-85c4f7957c-jtbfr to ip-10-0-134-155.ec2.internal

openshift-ingress

kube-auth-proxy-58666cb9df-chk6f

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-58666cb9df-chk6f to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4805aacc-openshift-default-78cc674747-nljxj to ip-10-0-134-155.ec2.internal

opendatahub

maas-controller-5ff475d6d4-2b6sq

Scheduled

Successfully assigned opendatahub/maas-controller-5ff475d6d4-2b6sq to ip-10-0-134-155.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-9qv62

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9qv62 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt to ip-10-0-134-155.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-7ltxr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7ltxr to ip-10-0-134-155.ec2.internal

opendatahub

test-curl-7108-c55018

Scheduled

Successfully assigned opendatahub/test-curl-7108-c55018 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj to ip-10-0-134-155.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-wrscd

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-wrscd to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554 to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-47e9af-7cb88c595f-s7jrb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-47e9af-7cb88c595f-s7jrb to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-5znqb to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-ait-8d386766-openshift-default-575667689c-n858k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8d386766-openshift-default-575667689c-n858k to ip-10-0-130-57.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-4l98m

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-4l98m to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt to ip-10-0-130-57.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-8b55h

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-8b55h to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-8928h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-8928h to ip-10-0-130-57.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-mjffb

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-mjffb to ip-10-0-134-155.ec2.internal

opendatahub

test-curl-7108-e075d1

Scheduled

Successfully assigned opendatahub/test-curl-7108-e075d1 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs to ip-10-0-140-110.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-54z7t

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-54z7t to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-171edd-766c966749-c55nm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-171edd-766c966749-c55nm to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-108ad8-7495778969-49t8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-108ad8-7495778969-49t8z to ip-10-0-130-57.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-qdpw6

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-qdpw6 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt to ip-10-0-134-155.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-gsxbf

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-gsxbf to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-99ca0c-787d86f4c5-rhkjg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-99ca0c-787d86f4c5-rhkjg to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-67f7j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-67f7j to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-b4nmd to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-crjjl to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f8a8088d-7bb6787865-bmt6k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f8a8088d-7bb6787865-bmt6k to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-autores-7229f2-7b7cfc846f-4h24n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-7229f2-7b7cfc846f-4h24n to ip-10-0-134-155.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-mqjnw

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-mqjnw to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-dlm7k to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-gnfkb to ip-10-0-140-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-hgv9r to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-j7hwx to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-a43a70-579b95c6df-7m45l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a43a70-579b95c6df-7m45l to ip-10-0-130-57.ec2.internal

opendatahub

ai-gateway-controller-6dc65d95b6-gpnbc

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6dc65d95b6-gpnbc to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9 to ip-10-0-130-57.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-phl42

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-phl42 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-jllqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-jllqw to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-r5kx6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-r5kx6 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-l4cmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-l4cmb to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-427ss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-427ss to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-kchch

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-kchch to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-kch6z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-kch6z to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-99ca0c-568c687f79-tqpf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-99ca0c-568c687f79-tqpf6 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f8a8088d-858594b57f-d7j74

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f8a8088d-858594b57f-d7j74 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-7229f2-798cdf44cf-4wm7j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-7229f2-798cdf44cf-4wm7j to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a43a70-85d6b96975-wzq5w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a43a70-85d6b96975-wzq5w to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-d4pt4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-d4pt4 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-m9qg8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-146320d5-65b76f4b67-m9qg8 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4 to ip-10-0-130-57.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-mprn9

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-mprn9 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-jpmqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-jpmqw to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9883e4-6b849c5655-vlf6g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9883e4-6b849c5655-vlf6g to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-vwbxc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-vwbxc to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-801218-7bd7574847-2fgt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-801218-7bd7574847-2fgt5 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8d386766-9d98995bc-8srn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8d386766-9d98995bc-8srn5 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-x76x7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-x76x7 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-qq7nn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-qq7nn to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-t4295

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-t4295 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-4r9lt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-4r9lt to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-5cpz6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-5cpz6 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-k862v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-k862v to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-b7rtc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-b7rtc to ip-10-0-130-57.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-9mgfd

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-9mgfd to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-4mxw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-4mxw7 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-jnjrl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-jnjrl to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7q4drj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7q4drj to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8w5ksw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-9632aa-55bd8w5ksw to ip-10-0-130-57.ec2.internal

llm

e2e-prio-pool-119c987e-kserve-66959d954d-kln77

Scheduled

Successfully assigned llm/e2e-prio-pool-119c987e-kserve-66959d954d-kln77 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x to ip-10-0-134-155.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-79b6bb9d79-r29jd to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2 to ip-10-0-134-155.ec2.internal

llm

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

Scheduled

Successfully assigned llm/e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk to ip-10-0-134-155.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-79b6bb9d79-gcpjq to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8 to ip-10-0-130-57.ec2.internal

models-as-a-service

payload-processing-external-model-f445668d4-gmmrd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-f445668d4-gmmrd to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz to ip-10-0-130-57.ec2.internal

models-as-a-service

payload-processing-external-model-bf555d5c7-mjl5l

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-bf555d5c7-mjl5l to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-5534f0-869ff6db4pxdqx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-5534f0-869ff6db4pxdqx to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-9632aa-687df6dccwv6lt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-9632aa-687df6dccwv6lt to ip-10-0-130-57.ec2.internal

llm

e2e-same-id-a-784e0608-kserve-7cdf47df77-sn6vk

Scheduled

Successfully assigned llm/e2e-same-id-a-784e0608-kserve-7cdf47df77-sn6vk to ip-10-0-130-57.ec2.internal

ai-tenants

e2e-api-a-8c0086

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-8c0086: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-processing-e2e-ipp-b-7b4185-898d6c9df-fjswd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7b4185-898d6c9df-fjswd to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76 to ip-10-0-140-110.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-qzt2p

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-qzt2p to ip-10-0-140-110.ec2.internal

models-as-a-service

payload-processing-external-model-98755745d-wmjfq

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-98755745d-wmjfq to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw to ip-10-0-134-155.ec2.internal

models-as-a-service

payload-processing-external-model-98755745d-4s8cg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-98755745d-4s8cg to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c to ip-10-0-130-57.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-79b6bb9d79-2lpkb to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv to ip-10-0-130-57.ec2.internal

llm

e2e-same-id-a-784e0608

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-784e0608

llm

e2e-same-id-b-784e0608-kserve-6d98d66ff7-hz49g

Scheduled

Successfully assigned llm/e2e-same-id-b-784e0608-kserve-6d98d66ff7-hz49g to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-04d111-f77b9866c-2mzsk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-04d111-f77b9866c-2mzsk to ip-10-0-130-57.ec2.internal

models-as-a-service

payload-processing-external-model-85f4bbf964-9kp5p

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-85f4bbf964-9kp5p to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z to ip-10-0-130-57.ec2.internal

models-as-a-service

payload-processing-external-model-7cf99f468c-xjg96

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7cf99f468c-xjg96 to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6 to ip-10-0-130-57.ec2.internal

llm

e2e-same-id-b-784e0608

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-784e0608

llm

e2e-same-id-b-784e0608

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-gpzs9

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-gpzs9 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-hd54k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-hd54k to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-gjfv8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-gjfv8 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-lhxq5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-lhxq5 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-n2mk7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-n2mk7 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-6554894b6b-98v2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6554894b6b-98v2m to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-5bd7d6d88-dth2t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-5bd7d6d88-dth2t to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r to ip-10-0-130-57.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c44pm

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c44pm to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-55fbbbf9dc-cpb5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-cpb5g to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-6ddb9b8755-bwn8k

Scheduled

Successfully assigned openshift-ingress/payload-processing-6ddb9b8755-bwn8k to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-7d68ddf775-nv8tc

Scheduled

Successfully assigned openshift-ingress/payload-processing-7d68ddf775-nv8tc to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ait-16cda44a-589975f687-78vsg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-16cda44a-589975f687-78vsg to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ait-44f032ad-868c96f9c9-fvrrj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-44f032ad-868c96f9c9-fvrrj to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp to ip-10-0-130-57.ec2.internal

models-as-a-service

payload-processing-external-model-766b99cdcf-m2gpm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-766b99cdcf-m2gpm to ip-10-0-134-155.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-v7km4

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-v7km4 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7 to ip-10-0-130-57.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-6bd8768855-k2ztq

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6bd8768855-k2ztq to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-670795-openshift-default-764f54c759-gtm6t to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8d386766-564db46ccf-p7vc2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8d386766-564db46ccf-p7vc2 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-801218-5c988b64cf-w2d4l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-801218-5c988b64cf-w2d4l to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-8c0086-fd5c48549-k5ltz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-8c0086-fd5c48549-k5ltz to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-9883e4-6f4c589fd5-cmtkl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9883e4-6f4c589fd5-cmtkl to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-zw5nk to ip-10-0-140-110.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-cv556

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cv556 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-xwqm7 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2 to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-wzfdx to ip-10-0-140-110.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0fc77f-6d886fb5cf-tht76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0fc77f-6d886fb5cf-tht76 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-wmkf5 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7 to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-srnk2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-srnk2 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-shld4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-shld4 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-rzxt7 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-rgj85 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-rdnft

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-rdnft to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-qfbk4 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-ptb2g to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-pr6rq to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv to ip-10-0-130-57.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq to ip-10-0-140-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-pghv7 to ip-10-0-130-57.ec2.internal

models-as-a-service

payload-processing-external-model-6c6d95cc8-gk8xd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6c6d95cc8-gk8xd to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk to ip-10-0-140-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-p6f5x to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-nv4mk to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-n5dnl to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-mrx9s to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-m56vf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-m56vf to ip-10-0-140-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-lqrr5 to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-lj6bl to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-l4jlq to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp to ip-10-0-134-155.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-jd8wd to ip-10-0-140-110.ec2.internal

models-as-a-service

payload-processing-external-model-57567b5c87-8r7nx

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-57567b5c87-8r7nx to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6 to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-895sj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-895sj to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-g99lj to ip-10-0-140-110.ec2.internal

models-as-a-service

payload-processing-external-model-57d6774b9c-pzf46

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-57d6774b9c-pzf46 to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm to ip-10-0-134-155.ec2.internal

openshift-ingress

router-default-678d747c5f-bgj92

Scheduled

Successfully assigned openshift-ingress/router-default-678d747c5f-bgj92 to ip-10-0-130-57.ec2.internal

openshift-ingress

router-default-678d747c5f-bgj92

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-678d747c5f-bgj92

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-processing-e2e-api-b-9154a6-6cb7bfddbf-mcqng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9154a6-6cb7bfddbf-mcqng to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s to ip-10-0-130-57.ec2.internal

models-as-a-service

payload-processing-external-model-5bcd7997-zdvn7

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-zdvn7 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt to ip-10-0-140-110.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-rxktx to ip-10-0-130-57.ec2.internal

models-as-a-service

payload-processing-external-model-6c6d95cc8-5ww4s

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6c6d95cc8-5ww4s to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-x829c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-x829c to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-xln8x to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-965f61-openshift-default-55854964c-zmth9 to ip-10-0-134-155.ec2.internal

openshift-jobset-operator

jobset-controller-manager-766d8d5547-gddts

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-766d8d5547-gddts to ip-10-0-130-57.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-678d747c5f from 0 to 1

openshift-ingress

replicaset-controller

router-default-678d747c5f

SuccessfulCreate

Created pod: router-default-678d747c5f-bgj92

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-678d747c5f-bgj92

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-678d747c5f-bgj92

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-678d747c5f-bgj92

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-678d747c5f-bgj92

Started

Container started

openshift-ingress

kubelet

router-default-678d747c5f-bgj92

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-678d747c5f-bgj92

Created

Container created

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-bvgmx

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-bvgmx

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bvgmx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bvgmx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.977s (2.977s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bvgmx

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bvgmx

Created

Container created

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bvgmx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-pghv7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bvgmx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-6bd8768855 from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-6bd8768855

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-6bd8768855-k2ztq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-6bd8768855-k2ztq

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-k2ztq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.25s (6.25s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-k2ztq

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-k2ztq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.501s (6.501s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-k2ztq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-79b6bb9d79

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-79b6bb9d79 from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-79b6bb9d79

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-79b6bb9d79-r29jd

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-79b6bb9d79

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-6wsnk

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

opendatahub-operator-system

operator-lifecycle-manager

install-5rp2d

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-6wsnk

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-6wsnk

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-rcj64

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Created

Container created

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-rcj64

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.749s (2.749s including waiting). Image size: 273709574 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-rcj64

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.047s (3.047s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 381ms (381ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.516s (3.516s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq_6aa85ed8-d47f-4f6c-8c86-d9a034bb0a51

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-79b6bb9d79-gcpjq_6aa85ed8-d47f-4f6c-8c86-d9a034bb0a51 became leader

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-rcj64

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-6wsnk

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-rcj64

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 1.716s (1.716s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-6wsnk

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.039s (3.039s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-rcj64

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-6wsnk

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 301ms (301ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-r29jd

Created

Container created

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-79b6bb9d79-2lpkb

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 340ms (340ms including waiting). Image size: 273709574 bytes.
(x10)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-gsxbf

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

cert-manager

multus

cert-manager-597b95cb84-b5jf6

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-b5jf6

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-b5jf6

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-gsxbf

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-gsxbf

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-b5jf6

cert-manager

kubelet

cert-manager-597b95cb84-b5jf6

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

limitador-operator-controller-manager-5778bb4449-gsxbf_06cc4138-cf0d-4d97-8080-222aa924c342

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-gsxbf_06cc4138-cf0d-4d97-8080-222aa924c342 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-gsxbf

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-gsxbf

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-gsxbf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.881s (2.881s including waiting). Image size: 177967631 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-qzt2p

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-qzt2p
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-qzt2p

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-9qv62

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-9qv62

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-9qv62

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-qzt2p

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.421s (3.421s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-qzt2p

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-qzt2p

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-qzt2p_c7e94047-2bbc-4045-9b5f-f2fe89648243 became leader

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-ggcnf

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-9qv62

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-9qv62

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-9qv62

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.233s (4.233s including waiting). Image size: 424244516 bytes.

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-ggcnf

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-ggcnf

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-9qv62_96a8811d-b4ec-4e62-bb89-1a781799eef8

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-9qv62_96a8811d-b4ec-4e62-bb89-1a781799eef8 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-ggcnf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.367s (2.367s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-ggcnf

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-ggcnf

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

dns-operator-controller-manager-8557cbdb84-ggcnf_0c1f7f43-5bb7-4398-958f-645bc0123e5b

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-ggcnf_0c1f7f43-5bb7-4398-958f-645bc0123e5b became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-r22dt

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

kuadrant-system

multus

authorino-operator-7b7bb4bc77-r22dt

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-sqjb4

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-r22dt

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-58666cb9df from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-58666cb9df

SuccessfulCreate

Created pod: kube-auth-proxy-58666cb9df-892tn

openshift-ingress

replicaset-controller

kube-auth-proxy-58666cb9df

SuccessfulCreate

Created pod: kube-auth-proxy-58666cb9df-chk6f

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68dd7b898f from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68dd7b898f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68dd7b898flnvv2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898flnvv2

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898flnvv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-4l98m

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-58666cb9df-892tn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68dd7b898flnvv2

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-58666cb9df-chk6f

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-58666cb9df-chk6f

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sqjb4

FailedMount

MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898flnvv2

Started

Container started

openshift-ingress

multus

kube-auth-proxy-58666cb9df-892tn

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4l98m

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-r22dt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.796s (1.796s including waiting). Image size: 167738465 bytes.

kuadrant-system

authorino-operator-7b7bb4bc77-r22dt_32e676d5-a326-4fbb-9f2d-9aa6738b3839

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-r22dt_32e676d5-a326-4fbb-9f2d-9aa6738b3839 became leader
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": tls: failed to verify certificate: x509: certificate signed by unknown authority

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-sqjb4

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sqjb4

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

multus

limitador-limitador-74dfcfb894-4l98m

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-r22dt

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-r22dt

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-58666cb9df-chk6f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.362s (2.362s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-58666cb9df-chk6f

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-58666cb9df-chk6f

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-58666cb9df-892tn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.857s (2.857s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-58666cb9df-892tn

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-58666cb9df-892tn

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4l98m

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.786s (2.786s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4l98m

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4l98m

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sqjb4

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sqjb4

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sqjb4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.081s (5.081s including waiting). Image size: 342538866 bytes.

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-mjffb

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-vwcwp

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-vwcwp

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-vwcwp

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-vwcwp

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-mjffb

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-mjffb

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-vwcwp

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-mjffb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.579s (1.579s including waiting). Image size: 195729000 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-mjffb

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-mjffb

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-v4qkp"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-9qv62

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-9qv62

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-tk9f7"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-766d8d5547

SuccessfulCreate

Created pod: jobset-controller-manager-766d8d5547-gddts

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-766d8d5547 from 0 to 1

openshift-jobset-operator

multus

jobset-controller-manager-766d8d5547-gddts

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-766d8d5547-gddts

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

kubelet

jobset-controller-manager-766d8d5547-gddts

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-766d8d5547-gddts

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-766d8d5547-gddts

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.69s (2.691s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

jobset-controller-manager-766d8d5547-gddts_ae69c958-7015-44b5-b80c-6cf185a86897

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-766d8d5547-gddts_ae69c958-7015-44b5-b80c-6cf185a86897 became leader

opendatahub

kserve-module-controller-manager-7566cf5fc8-mjffb_b14d40b0-93b2-4107-b909-ede042d938b1

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-mjffb_b14d40b0-93b2-4107-b909-ede042d938b1 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-54z7t

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-vwcwp_bed2d225-8181-477e-954e-bd4b2ff18b9b

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-vwcwp_bed2d225-8181-477e-954e-bd4b2ff18b9b became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

multus

limitador-limitador-7c9b87d574-54z7t

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-z7gvh

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-54z7t

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-mgrwq

kuadrant-system

kubelet

authorino-57f7f8659f-z7gvh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-z7gvh

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-54z7t

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.153s (2.153s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-54z7t

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-54z7t

Started

Container started

kuadrant-system

multus

authorino-56c6c9ddd5-mgrwq

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgrwq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-57f7f8659f-z7gvh

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgrwq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.208s (1.208s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgrwq

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-z7gvh

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgrwq

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-z7gvh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.825s (1.825s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-z7gvh

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-z7gvh

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-4l98m

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4l98m

Killing

Stopping container limitador

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4l98m

Unhealthy

Readiness probe failed: Get "http://10.134.0.30:8080/status": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-7ltxr

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7ltxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-7ltxr

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7ltxr

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7ltxr

Started

Container started

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-wrscd

opendatahub

multus

odh-model-controller-769875db56-5qwzx

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

model-serving-api-75bd89fdfc-9mrkv

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

kserve-controller-manager-776cc66d47-qdpw6

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bvgmx

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-bvgmx

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qdpw6

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-qdpw6

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

multus

model-serving-api-75bd89fdfc-9mrkv

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wrscd

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-wrscd

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-9mrkv

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-5qwzx

opendatahub

kubelet

odh-model-controller-769875db56-5qwzx

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wrscd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.668s (3.668s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wrscd

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wrscd

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-9mrkv

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qdpw6

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.088s (4.088s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-9mrkv

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-9mrkv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.175s (3.175s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qdpw6

Started

Container started

opendatahub

odh-model-controller-769875db56-5qwzx_edc9c127-12b0-4ecb-b7b7-7613ba895440

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-5qwzx_edc9c127-12b0-4ecb-b7b7-7613ba895440 became leader

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qdpw6

Created

Container created

opendatahub

kserve-controller-manager-776cc66d47-qdpw6_e12c92df-e1ba-4fe8-bdf8-d7b8aac06258

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-qdpw6_e12c92df-e1ba-4fe8-bdf8-d7b8aac06258 became leader

opendatahub

kubelet

odh-model-controller-769875db56-5qwzx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.396s (4.396s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-5qwzx

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-5qwzx

Started

Container started

opendatahub

llmisvc-controller-manager-869d5dcc5d-wrscd_c53d94bc-0791-4f9e-bddc-be6e397190fe

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-wrscd_c53d94bc-0791-4f9e-bddc-be6e397190fe became leader

opendatahub

replicaset-controller

maas-controller-85c4f7957c

SuccessfulCreate

Created pod: maas-controller-85c4f7957c-mh7qn

opendatahub

kubelet

maas-controller-5ff475d6d4-2b6sq

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:2a8af487b02cdd2697131845886ed681d44962affee63d93743ff642af9d7a27"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5ff475d6d4 from 0 to 1

opendatahub

replicaset-controller

maas-controller-5ff475d6d4

SuccessfulCreate

Created pod: maas-controller-5ff475d6d4-2b6sq

opendatahub

multus

maas-controller-5ff475d6d4-2b6sq

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub

multus

maas-controller-85c4f7957c-mh7qn

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-85c4f7957c-mh7qn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:2a8af487b02cdd2697131845886ed681d44962affee63d93743ff642af9d7a27"

opendatahub

kubelet

maas-controller-5ff475d6d4-2b6sq

Created

Container created

opendatahub

kubelet

maas-controller-5ff475d6d4-2b6sq

Started

Container started

opendatahub

kubelet

maas-controller-5ff475d6d4-2b6sq

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:2a8af487b02cdd2697131845886ed681d44962affee63d93743ff642af9d7a27" in 2.778s (2.778s including waiting). Image size: 200094741 bytes.

opendatahub

maas-controller-5ff475d6d4-2b6sq_aac61000-700c-4447-be6c-03434e776e8c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5ff475d6d4-2b6sq_aac61000-700c-4447-be6c-03434e776e8c became leader

opendatahub

kubelet

maas-controller-85c4f7957c-mh7qn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:2a8af487b02cdd2697131845886ed681d44962affee63d93743ff642af9d7a27" in 2.64s (2.64s including waiting). Image size: 200094741 bytes.

opendatahub

kubelet

maas-controller-85c4f7957c-mh7qn

Created

Container created

opendatahub

kubelet

maas-controller-85c4f7957c-mh7qn

Started

Container started

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-zzvpx

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-zzvpx

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-zzvpx

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

replicaset-controller

maas-controller-5ff475d6d4

SuccessfulDelete

Deleted pod: maas-controller-5ff475d6d4-2b6sq
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5ff475d6d4 from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-zzvpx

Created

Container created

opendatahub

kubelet

maas-controller-5ff475d6d4-2b6sq

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-zzvpx

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-zzvpx

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.698s (10.698s including waiting). Image size: 1089502687 bytes.

opendatahub

maas-controller-85c4f7957c-mh7qn_c2871635-3878-4f91-87cf-af5e097440f1

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-85c4f7957c-mh7qn_c2871635-3878-4f91-87cf-af5e097440f1 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-9wgm4

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Started

Container started

kuadrant-system

kubelet

authorino-5698fc8df4-kqgsq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6889cbd8c4-lthv8

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-lthv8

kuadrant-system

multus

authorino-6889cbd8c4-lthv8

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

kuadrant-system

multus

authorino-5698fc8df4-kqgsq

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-5698fc8df4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-lthv8
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-9wgm4

kuadrant-system

replicaset-controller

authorino-5698fc8df4

SuccessfulCreate

Created pod: authorino-5698fc8df4-kqgsq

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

kubelet

authorino-6889cbd8c4-lthv8

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-lthv8

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-lthv8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 465ms (465ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-lthv8

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-5698fc8df4-kqgsq

Created

Container created

kuadrant-system

kubelet

authorino-5698fc8df4-kqgsq

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgrwq

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-mgrwq

kuadrant-system

kubelet

authorino-5698fc8df4-kqgsq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.315s (2.315s including waiting). Image size: 204096810 bytes.

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-8b55h

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8b55h

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8b55h

Started

Container started

opendatahub

multus

llmisvc-controller-manager-6466c554d8-8b55h

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8b55h

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8b55h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 391ms (391ms including waiting). Image size: 235100981 bytes.
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-wrscd

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wrscd

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-mqjnw

opendatahub

multus

ai-gateway-controller-7d85675f98-mqjnw

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-mqjnw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-mqjnw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.525s (1.525s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-mqjnw

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-mqjnw

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-mqjnw_34f9170e-c041-494c-9230-d70993844f7f

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-mqjnw_34f9170e-c041-494c-9230-d70993844f7f became leader

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-n2mk7

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-n2mk7

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2mk7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-cpb5g
(x6)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-55fbbbf9dc-cpb5g

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-cpb5g

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2mk7

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-cpb5g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.236s (2.236s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2mk7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2mk7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.294s (2.294s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-cpb5g

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-cpb5g

Created

Container created

opendatahub

replicaset-controller

ai-gateway-controller-6dc65d95b6

SuccessfulCreate

Created pod: ai-gateway-controller-6dc65d95b6-gpnbc

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6dc65d95b6 from 0 to 1

opendatahub

multus

ai-gateway-controller-6dc65d95b6-gpnbc

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6dc65d95b6-gpnbc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

llmisvc-controller-manager-6466c554d8-8b55h_2c694563-5e60-48ad-9a0f-9527a7c9a8ec

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-8b55h_2c694563-5e60-48ad-9a0f-9527a7c9a8ec became leader

opendatahub

kubelet

ai-gateway-controller-6dc65d95b6-gpnbc

Created

Container created

opendatahub

kubelet

ai-gateway-controller-6dc65d95b6-gpnbc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.112s (2.112s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-6dc65d95b6-gpnbc

Started

Container started

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-mqjnw

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-mqjnw

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-phl42

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-phl42

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-phl42

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-phl42

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.203s (1.203s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-phl42

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-phl42

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-mprn9

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-mprn9

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-mprn9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-mprn9

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-9mgfd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-mprn9

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-mprn9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.241s (1.241s including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-9mgfd

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-9mgfd

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-9mgfd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 210ms (210ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-9mgfd

Created

Container created

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-9mgfd

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-gpzs9

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-gpzs9

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-gpzs9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 203ms (203ms including waiting). Image size: 98346788 bytes.

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-gpzs9

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-gpzs9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-gpzs9

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

opendatahub

ai-gateway-controller-6dc65d95b6-gpnbc_0be5dca8-9e36-446d-b9b5-47f83cc76242

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6dc65d95b6-gpnbc_0be5dca8-9e36-446d-b9b5-47f83cc76242 became leader

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c44pm

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c44pm

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c44pm

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c44pm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 209ms (209ms including waiting). Image size: 98346788 bytes.

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c44pm

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-v7km4

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c44pm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

kubelet

echo-simulator-kserve-64b6f8f96c-v7km4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-v7km4

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-cv556

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-v7km4

Started

Container started

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-cv556

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cv556

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

echo-simulator-kserve-64b6f8f96c-v7km4

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-v7km4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.522s (1.522s including waiting). Image size: 78208878 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cv556

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 196ms (196ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cv556

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cv556

Started

Container started

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 203ms (203ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

kuadrant-system

multus

authorino-77ddb887cc-6csbj

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-77ddb887cc

SuccessfulCreate

Created pod: authorino-77ddb887cc-6csbj

kuadrant-system

kubelet

authorino-77ddb887cc-6csbj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-77ddb887cc-6csbj

Created

Container created

kuadrant-system

kubelet

authorino-77ddb887cc-6csbj

Started

Container started

kuadrant-system

kubelet

authorino-77ddb887cc-6csbj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 662ms (662ms including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-5698fc8df4

SuccessfulDelete

Deleted pod: authorino-5698fc8df4-kqgsq
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-5698fc8df4 from 1 to 0

kuadrant-system

kubelet

authorino-5698fc8df4-kqgsq

Killing

Stopping container authorino

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-srnk2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-crjjl

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 1 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-srnk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-srnk2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-srnk2

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-srnk2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.588s (2.588s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.705s (2.705s including waiting). Image size: 183555333 bytes.
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-srnk2

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-srnk2

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 4 to 7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-44f032ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-44f032ad-openshift-default-5f845cc957 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-16cda44a-openshift-default-778c87d957

SuccessfulCreate

Created pod: e2e-ait-16cda44a-openshift-default-778c87d957-665xc

openshift-ingress

deployment-controller

e2e-ait-16cda44a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-16cda44a-openshift-default-778c87d957 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-44f032ad-openshift-default-5f845cc957

SuccessfulCreate

Created pod: e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

openshift-ingress

gateway_labeler_controller

e2e-ait-44f032ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-44f032ad

openshift-ingress

gateway_labeler_controller

e2e-ait-16cda44a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-16cda44a

openshift-ingress

gateway_labeler_controller

e2e-migrate-a0d1a61d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a0d1a61d-gw

openshift-ingress

deployment-controller

e2e-migrate-a0d1a61d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf from 0 to 1

openshift-ingress

multus

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf

SuccessfulCreate

Created pod: e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

openshift-ingress

deployment-controller

e2e-ait-4805aacc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4805aacc-openshift-default-78cc674747 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-4805aacc-openshift-default-78cc674747

SuccessfulCreate

Created pod: e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

openshift-ingress

gateway_labeler_controller

e2e-ait-4805aacc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4805aacc

openshift-ingress

multus

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-16cda44a-589975f687

FailedCreate

Error creating: pods "payload-processing-e2e-ait-16cda44a-589975f687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-16cda44a: serviceaccount "payload-processing-e2e-ait-16cda44a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-16cda44a-589975f687

SuccessfulCreate

Created pod: payload-processing-e2e-ait-16cda44a-589975f687-78vsg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-16cda44a-59f4f898bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-lhxq5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-16cda44a-59f4f898bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-16cda44a: serviceaccount "payload-processing-e2e-ait-16cda44a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-lhxq5

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-16cda44a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-16cda44a-59f4f898bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-16cda44a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-16cda44a-589975f687 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a0d1a61d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a0d1a61d-6499787965 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-lhxq5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-16cda44a-589975f687-78vsg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-16cda44a-589975f687-78vsg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a0d1a61d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-16cda44a-589975f687-78vsg

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a0d1a61d: serviceaccount "payload-processing-e2e-migrate-a0d1a61d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-lhxq5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a0d1a61d-6499787965

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a0d1a61d-6499787965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a0d1a61d: serviceaccount "payload-processing-e2e-migrate-a0d1a61d" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-16cda44a-589975f687-78vsg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-lhxq5

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a0d1a61d-6499787965

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-kch6z

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-kch6z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-kch6z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-kch6z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-kch6z

openshift-ingress

deployment-controller

e2e-derive-f8a8088d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f8a8088d-openshift-default-5b7849fcb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f8a8088d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f8a8088d

openshift-ingress

replicaset-controller

e2e-derive-f8a8088d-openshift-default-5b7849fcb5

SuccessfulCreate

Created pod: e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-44f032ad-868c96f9c9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-44f032ad-868c96f9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-44f032ad: serviceaccount "payload-processing-e2e-ait-44f032ad" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-44f032ad-868c96f9c9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-44f032ad-868c96f9c9-fvrrj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-44f032ad-7b89c4449f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-gjfv8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-44f032ad-7b89c4449f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-44f032ad: serviceaccount "payload-processing-e2e-ait-44f032ad" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-44f032ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-44f032ad-868c96f9c9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-44f032ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-44f032ad-7b89c4449f from 0 to 1

openshift-ingress

multus

e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-44f032ad-868c96f9c9-fvrrj

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4805aacc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4805aacc-9f4bd74bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4805aacc-9f4bd74bf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4805aacc-9f4bd74bf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4805aacc-9f4bd74bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4805aacc: serviceaccount "payload-processing-e2e-ait-4805aacc" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.588s (2.588s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4805aacc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4805aacc-77dfbbd755 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-gjfv8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-hd54k

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-hd54k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4805aacc-77dfbbd755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-hd54k
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4805aacc-77dfbbd755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4805aacc: serviceaccount "payload-processing-e2e-ait-4805aacc" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-44f032ad-868c96f9c9-fvrrj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-44f032ad-868c96f9c9-fvrrj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-44f032ad-868c96f9c9-fvrrj

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-gjfv8

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-gjfv8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-gjfv8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-hd54k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-hd54k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.932s (1.932s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f8a8088d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f8a8088d-858594b57f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f8a8088d-7bb6787865

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f8a8088d-7bb6787865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f8a8088d: serviceaccount "payload-processing-e2e-derive-f8a8088d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f8a8088d-7bb6787865

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f8a8088d-7bb6787865-bmt6k

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f8a8088d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f8a8088d-7bb6787865 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f8a8088d-858594b57f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f8a8088d-858594b57f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f8a8088d: serviceaccount "payload-processing-e2e-derive-f8a8088d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f8a8088d-858594b57f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f8a8088d-858594b57f-d7j74

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f8a8088d-858594b57f-d7j74

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-f8a8088d-858594b57f-d7j74

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-f8a8088d-7bb6787865-bmt6k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-f8a8088d-7bb6787865-bmt6k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-f8a8088d-7bb6787865-bmt6k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f8a8088d-858594b57f-d7j74

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f8a8088d-858594b57f-d7j74

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-f8a8088d-7bb6787865-bmt6k

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4805aacc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": read tcp 10.133.0.2:59464->10.133.0.37:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": read tcp 10.133.0.2:59464->10.133.0.37:15021: read: connection reset by peer

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4805aacc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-f8a8088d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-f8a8088d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-16cda44a-589975f687-78vsg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-16cda44a-59f4f898bc-lhxq5

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-16cda44a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-16cda44a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-a0d1a61d-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-a0d1a61d-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

Started

Container started

openshift-ingress

deployment-controller

e2e-ait-44f032ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-44f032ad-openshift-default-5f845cc957 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-44f032ad-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

Created

Container created

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

Started

Container started

openshift-ingress

replicaset-controller

e2e-ait-44f032ad-openshift-default-5f845cc957

SuccessfulCreate

Created pod: e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ait-44f032ad-openshift-default-5f845cc957

SuccessfulCreate

Created pod: e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

openshift-ingress

replicaset-controller

e2e-ait-44f032ad-openshift-default-5f845cc957

SuccessfulCreate

Created pod: e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4805aacc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4805aacc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

Started

Container started

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

Created

Container created

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:51950->10.132.0.53:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:51950->10.132.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0d1a61d-58fd568b6c-kch6z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0d1a61d-6499787965-w979c

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-f8a8088d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-f8a8088d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-16cda44a-openshift-default-778c87d957-665xc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-09a20a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-09a20a

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4805aacc-77dfbbd755-hd54k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-4805aacc-9f4bd74bf-tbc8b

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-4c2387

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-4c2387

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr
(x6)

openshift-ingress

kubelet

e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-09a20a: serviceaccount "payload-processing-e2e-worker-w2-09a20a" not found

openshift-ingress

kubelet

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-a0d1a61d-gw-openshift-default-7789c75ddf-4pt7n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-09a20a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-09a20a: serviceaccount "payload-processing-e2e-worker-w2-09a20a" not found
(x6)

openshift-ingress

kubelet

e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-09a20a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-09a20a-b4f7d6d49 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-44f032ad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-44f032ad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f8a8088d-858594b57f-d7j74

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f8a8088d-7bb6787865-bmt6k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-965f61-openshift-default-55854964c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-44f032ad-868c96f9c9-fvrrj

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-965f61

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-965f61

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-44f032ad-7b89c4449f-gjfv8

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-4c2387

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-4c2387-78c59569f5 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4c2387: serviceaccount "payload-processing-e2e-worker-w3-4c2387" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4c2387-78c59569f5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-4c2387-78c59569f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4c2387: serviceaccount "payload-processing-e2e-worker-w3-4c2387" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-4c2387

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4c2387-78c59569f5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6

openshift-ingress

kubelet

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-4805aacc-openshift-default-78cc674747-nljxj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-f8a8088d-openshift-default-5b7849fcb5-bs6xr

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-965f61-576d68cfbf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-965f61-576d68cfbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-965f61: serviceaccount "payload-processing-e2e-worker-w0-965f61" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-965f61

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-965f61-576d68cfbf from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-965f61

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-965f61-84cf84d479 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-965f61-576d68cfbf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-965f61: serviceaccount "payload-processing-e2e-worker-w0-965f61" not found

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-439989

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-439989

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-hm4zb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-m6bjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-5wwbn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-44f032ad-openshift-default-5f845cc957-x7d92

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-c4006d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-c4006d

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 0 to 1

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-439989

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-439989-6b4f868455 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-439989-5d779f9865

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-439989-5d779f9865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-439989: serviceaccount "payload-processing-e2e-worker-w1-439989" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-439989-6b4f868455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-439989-6b4f868455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-439989: serviceaccount "payload-processing-e2e-worker-w1-439989" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-439989-5d779f9865

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-439989-6b4f868455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-439989

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-439989-5d779f9865 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-c4006d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-c4006d: serviceaccount "payload-processing-e2e-worker-w4-c4006d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-c4006d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-c4006d-7bd575dbdf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-c4006d: serviceaccount "payload-processing-e2e-worker-w4-c4006d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-965f61-openshift-default-55854964c from 1 to 2
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

Created

Container created

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-bf555d5c7

SuccessfulCreate

Created pod: payload-processing-external-model-bf555d5c7-mjl5l

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-bf555d5c7 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-bf555d5c7

FailedCreate

Error creating: pods "payload-processing-external-model-bf555d5c7-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-bf555d5c7-mjl5l

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-bf555d5c7-mjl5l

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-bf555d5c7-mjl5l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-bf555d5c7-mjl5l

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 7 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-57567b5c87 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-57567b5c87

SuccessfulCreate

Created pod: payload-processing-external-model-57567b5c87-8r7nx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-57567b5c87-8r7nx

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-57567b5c87-8r7nx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-57567b5c87-8r7nx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

Created

Container created

models-as-a-service

multus

payload-processing-external-model-57567b5c87-8r7nx

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 3 to 4

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

Started

Container started

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-bf555d5c7 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-bf555d5c7-mjl5l

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-bf555d5c7

SuccessfulDelete

Deleted pod: payload-processing-external-model-bf555d5c7-mjl5l
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-6c6d95cc8

SuccessfulCreate

Created pod: payload-processing-external-model-6c6d95cc8-5ww4s

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-5ww4s

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-5ww4s

Created

Container created

models-as-a-service

multus

payload-processing-external-model-6c6d95cc8-5ww4s

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-5ww4s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 4 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

ProbeError

Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

Unhealthy

Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-57567b5c87-8r7nx

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-57567b5c87

SuccessfulDelete

Deleted pod: payload-processing-external-model-57567b5c87-8r7nx

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-57567b5c87 from 1 to 0
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-f445668d4

SuccessfulCreate

Created pod: payload-processing-external-model-f445668d4-gmmrd

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-f445668d4 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-f445668d4-gmmrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-f445668d4-gmmrd

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-f445668d4-gmmrd

Created

Container created

models-as-a-service

multus

payload-processing-external-model-f445668d4-gmmrd

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6c6d95cc8 from 1 to 0

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 2 to 3

models-as-a-service

replicaset-controller

payload-processing-external-model-6c6d95cc8

SuccessfulDelete

Deleted pod: payload-processing-external-model-6c6d95cc8-5ww4s

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-5ww4s

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 5 to 7

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-6c6d95cc8

SuccessfulCreate

Created pod: payload-processing-external-model-6c6d95cc8-gk8xd
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6c6d95cc8 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-gk8xd

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-gk8xd

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-gk8xd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6c6d95cc8-gk8xd

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Started

Container started

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-f445668d4-gmmrd

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-gk8xd

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-gk8xd

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-external-model-plugins" not found
(x4)

models-as-a-service

kubelet

payload-processing-external-model-6c6d95cc8-gk8xd

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-cdd9c78cff58" not found

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 2 to 3

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

Started

Container started

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-965f61-openshift-default-55854964c from 2 to 4

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

Unhealthy

Readiness probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Unhealthy

Liveness probe failed: Get "https://10.133.0.34:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

ProbeError

Readiness probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

Created

Container created

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-965f61-openshift-default-55854964c from 4 to 5

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

ProbeError

Readiness probe error: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Unhealthy

Readiness probe failed: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 7 to 10
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulCreate

Created pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

Started

Container started

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

Started

Container started

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

Created

Container created

openshift-ingress

multus

e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

ProbeError

Readiness probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

Unhealthy

Readiness probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

Created

Container created

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-146320d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-146320d5

openshift-ingress

replicaset-controller

e2e-mt-146320d5-openshift-default-75cbf47c85

SuccessfulCreate

Created pod: e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

openshift-ingress

deployment-controller

e2e-mt-146320d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-146320d5-openshift-default-75cbf47c85 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-146320d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-146320d5-65b76f4b67 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-146320d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-146320d5-586748b797 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-146320d5-586748b797-4lhzm

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-146320d5-65b76f4b67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-146320d5-65b76f4b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-146320d5: serviceaccount "payload-processing-e2e-mt-146320d5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-4lhzm

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-146320d5-65b76f4b67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-4lhzm

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-146320d5-586748b797

SuccessfulCreate

Created pod: payload-processing-e2e-mt-146320d5-586748b797-4lhzm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-146320d5-586748b797

FailedCreate

Error creating: pods "payload-processing-e2e-mt-146320d5-586748b797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-146320d5: serviceaccount "payload-processing-e2e-mt-146320d5" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-4lhzm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-965f61-openshift-default-55854964c from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Unhealthy

Liveness probe failed: Get "https://10.133.0.34:8000/health": context deadline exceeded

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

Unhealthy

Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-a-8c0086

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-8c0086

openshift-ingress

deployment-controller

e2e-api-a-8c0086-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-8c0086-openshift-default-58b446d58c from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

ProbeError

Startup probe error: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

ProbeError

Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

Unhealthy

Startup probe failed: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused

openshift-ingress

multus

e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-8c0086-openshift-default-58b446d58c

SuccessfulCreate

Created pod: e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-a-9883e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9883e4-openshift-default-5666f48c8c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-9883e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9883e4

openshift-ingress

replicaset-controller

e2e-api-a-9883e4-openshift-default-5666f48c8c

SuccessfulCreate

Created pod: e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t
(x8)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-8c0086

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-8c0086-78b8c6c95 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

multus

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8c0086-fd5c48549

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-8c0086-fd5c48549-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8c0086: serviceaccount "payload-processing-e2e-api-a-8c0086" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8c0086-78b8c6c95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8c0086: serviceaccount "payload-processing-e2e-api-a-8c0086" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-8c0086

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-8c0086-fd5c48549 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8c0086-fd5c48549

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-8c0086-fd5c48549-k5ltz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8c0086-78b8c6c95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-vwbxc
(x8)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-vwbxc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-8c0086-fd5c48549-k5ltz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-8c0086-fd5c48549-k5ltz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-8c0086-fd5c48549-k5ltz

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-vwbxc

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-8c0086-fd5c48549-k5ltz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-vwbxc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-vwbxc

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9883e4-6f4c589fd5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9883e4-6f4c589fd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9883e4: serviceaccount "payload-processing-e2e-api-a-9883e4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9883e4-6f4c589fd5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9883e4-6f4c589fd5-cmtkl

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9883e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9883e4-6f4c589fd5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9883e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9883e4-6b849c5655 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9883e4-6b849c5655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9883e4-6b849c5655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9883e4: serviceaccount "payload-processing-e2e-api-a-9883e4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9883e4-6b849c5655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9883e4-6b849c5655-vlf6g

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9883e4-6b849c5655-vlf6g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-9883e4-6f4c589fd5-cmtkl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-9883e4-6f4c589fd5-cmtkl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9883e4-6b849c5655-vlf6g

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

openshift-ingress

multus

payload-processing-e2e-api-a-9883e4-6f4c589fd5-cmtkl

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-9883e4-6f4c589fd5-cmtkl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9883e4-6b849c5655-vlf6g

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9883e4-6b849c5655-vlf6g

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Unhealthy

Readiness probe failed: Get "https://10.133.0.34:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-7wbkm

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.71s (2.71s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-api-b-0fc77f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0fc77f

openshift-ingress

deployment-controller

e2e-api-b-0fc77f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0fc77f-openshift-default-58dcf57b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-0fc77f-openshift-default-58dcf57b5

SuccessfulCreate

Created pod: e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

openshift-ingress

multus

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-146320d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-146320d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-a43a70

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a43a70

openshift-ingress

replicaset-controller

e2e-api-b-a43a70-openshift-default-59d5b5dcf

SuccessfulCreate

Created pod: e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-a43a70-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a43a70-openshift-default-59d5b5dcf from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0fc77f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0fc77f-774488f5b7 from 0 to 1

openshift-ingress

multus

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0fc77f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0fc77f-6d886fb5cf from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0fc77f-774488f5b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-jpmqw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0fc77f-6d886fb5cf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0fc77f-6d886fb5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0fc77f: serviceaccount "payload-processing-e2e-api-b-0fc77f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0fc77f-6d886fb5cf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0fc77f-6d886fb5cf-tht76
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0fc77f-774488f5b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0fc77f: serviceaccount "payload-processing-e2e-api-b-0fc77f" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-jpmqw

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

Unhealthy

Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-api-b-0fc77f-6d886fb5cf-tht76

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

ProbeError

Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-jpmqw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-jpmqw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-0fc77f-6d886fb5cf-tht76

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-0fc77f-6d886fb5cf-tht76

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-jpmqw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-0fc77f-6d886fb5cf-tht76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a43a70-579b95c6df

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a43a70-579b95c6df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a43a70: serviceaccount "payload-processing-e2e-api-b-a43a70" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a43a70-579b95c6df

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a43a70-579b95c6df-7m45l

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a43a70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a43a70-579b95c6df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a43a70-85d6b96975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a43a70-85d6b96975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a43a70: serviceaccount "payload-processing-e2e-api-b-a43a70" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a43a70-85d6b96975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a43a70-85d6b96975-wzq5w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a43a70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a43a70-85d6b96975 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a43a70-579b95c6df-7m45l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a43a70-85d6b96975-wzq5w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-a43a70-579b95c6df-7m45l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a43a70-85d6b96975-wzq5w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a43a70-85d6b96975-wzq5w

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a43a70-85d6b96975-wzq5w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-a43a70-579b95c6df-7m45l

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-a43a70-579b95c6df-7m45l

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-146320d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-146320d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 5 to 8

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8c0086-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8c0086-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

Unhealthy

Readiness probe failed: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

ProbeError

Readiness probe error: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

Started

Container started

opendatahub

kubelet

test-curl-7102-606b8f

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7102-606b8f

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7102-606b8f

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.389s (3.389s including waiting). Image size: 106100986 bytes.
(x5)

openshift-ingress

kubelet

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused

opendatahub

kubelet

test-curl-7102-606b8f

Created

Container created

opendatahub

kubelet

test-curl-7102-606b8f

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7102-606b8f

Killing

Stopping container test-curl-7102-606b8f

openshift-ingress

kubelet

payload-processing-e2e-api-a-8c0086-fd5c48549-k5ltz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8c0086-78b8c6c95-vwbxc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-9883e4-6f4c589fd5-cmtkl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9883e4-6b849c5655-vlf6g

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9883e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9883e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-4lhzm

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0fc77f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0fc77f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a43a70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a43a70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-8c0086-openshift-default-58b446d58c-cdgtp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-4lhzm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-fnz6w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0fc77f-774488f5b7-jpmqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0fc77f-6d886fb5cf-tht76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-9883e4-openshift-default-5666f48c8c-g9v2t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a43a70-85d6b96975-wzq5w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a43a70-579b95c6df-7m45l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-0fc77f-openshift-default-58dcf57b5-md2jv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c

SuccessfulCreate

Created pod: e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

openshift-ingress

deployment-controller

e2e-ipp-a-3430f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3430f6-openshift-default-595d4f6b8c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3430f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3430f6

openshift-ingress

replicaset-controller

e2e-ipp-a-f91cd1-openshift-default-556cb85755

SuccessfulCreate

Created pod: e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f91cd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f91cd1

openshift-ingress

multus

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-f91cd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f91cd1-openshift-default-556cb85755 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-146320d5-586748b797

FailedCreate

Error creating: pods "payload-processing-e2e-mt-146320d5-586748b797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-146320d5: serviceaccount "payload-processing-e2e-mt-146320d5" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-146320d5-65b76f4b67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-146320d5-65b76f4b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-146320d5: serviceaccount "payload-processing-e2e-mt-146320d5" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a43a70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a43a70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-146320d5-586748b797

SuccessfulCreate

Created pod: payload-processing-e2e-mt-146320d5-586748b797-k74kx

openshift-ingress

deployment-controller

payload-processing-e2e-mt-146320d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-146320d5-586748b797 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-146320d5-65b76f4b67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-146320d5-65b76f4b67-m9qg8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-146320d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-146320d5-65b76f4b67 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-k74kx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-k74kx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-m9qg8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-k74kx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-m9qg8

Created

Container created

openshift-ingress

kubelet

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-m9qg8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-m9qg8

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-146320d5-586748b797-k74kx

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3430f6: serviceaccount "payload-processing-e2e-ipp-a-3430f6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3430f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3430f6: serviceaccount "payload-processing-e2e-ipp-a-3430f6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3430f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3430f6-7b4cd58d57 from 0 to 1

openshift-ingress

kubelet

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-a43a70-openshift-default-59d5b5dcf-rlkth

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv

openshift-ingress

deployment-controller

e2e-ipp-a-ceba51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-ceba51-openshift-default-d46fffd85 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-ceba51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-ceba51

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-ceba51-openshift-default-d46fffd85

SuccessfulCreate

Created pod: e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f91cd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f91cd1: serviceaccount "payload-processing-e2e-ipp-a-f91cd1" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f91cd1-6688fc5c7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f91cd1: serviceaccount "payload-processing-e2e-ipp-a-f91cd1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f91cd1-6688fc5c7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-x47zn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f91cd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f91cd1-6688fc5c7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-4m89w

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-4m89w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-x47zn

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-4m89w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-x47zn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-4m89w

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-x47zn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-x47zn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-4m89w

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ceba51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ceba51-bb5fb7d99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ceba51-bb5fb7d99

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-nbdsj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ceba51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ceba51-bb5fb7d99

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ceba51: serviceaccount "payload-processing-e2e-ipp-a-ceba51" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ceba51: serviceaccount "payload-processing-e2e-ipp-a-ceba51" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-nbdsj

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-ss4kp

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-ss4kp

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-nbdsj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-nbdsj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-nbdsj

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-ss4kp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-ss4kp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-ss4kp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-fnhnx

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-fnhnx

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fnhnx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fnhnx

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fnhnx

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fnhnx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.756s (2.756s including waiting). Image size: 185476477 bytes.

openshift-ingress

deployment-controller

e2e-api-a-801218-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-801218-openshift-default-58b4b8685c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-801218-openshift-default-58b4b8685c

SuccessfulCreate

Created pod: e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

openshift-ingress

gateway_labeler_controller

e2e-api-a-801218

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-801218

openshift-ingress

multus

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

opendatahub

multus

test-curl-7102-0c87d7

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7102-0c87d7

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7102-0c87d7

Started

Container started

opendatahub

kubelet

test-curl-7102-0c87d7

Created

Container created

opendatahub

kubelet

test-curl-7102-0c87d7

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.324s (2.324s including waiting). Image size: 106100986 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-801218

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-801218-5c988b64cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-801218-7bd7574847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-801218-7bd7574847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-801218: serviceaccount "payload-processing-e2e-api-a-801218" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-801218

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-801218-7bd7574847 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-801218-5c988b64cf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-801218-5c988b64cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-801218: serviceaccount "payload-processing-e2e-api-a-801218" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-801218-5c988b64cf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-801218-5c988b64cf-w2d4l

openshift-ingress

multus

payload-pre-processing-e2e-api-a-801218-7bd7574847-2fgt5

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-801218-5c988b64cf-w2d4l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7102-0c87d7

Killing

Stopping container test-curl-7102-0c87d7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-801218-7bd7574847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-801218-7bd7574847-2fgt5

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-801218-7bd7574847-2fgt5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-801218-5c988b64cf-w2d4l

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-801218-7bd7574847-2fgt5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-801218-5c988b64cf-w2d4l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-801218-5c988b64cf-w2d4l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-801218-7bd7574847-2fgt5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-54fbfd87bc-4m89w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f91cd1-6688fc5c7-x47zn

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b8bb1e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b8bb1e

openshift-ingress

deployment-controller

e2e-ipp-b-b8bb1e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b8bb1e-openshift-default-557bbf897c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c

SuccessfulCreate

Created pod: e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

openshift-ingress

multus

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-7b4cd58d57-jm4mv

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.151:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-664c86db9f-xxx7v

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.150:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ceba51-5f4d757d95-ss4kp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ceba51-bb5fb7d99-nbdsj

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b8bb1e: serviceaccount "payload-processing-e2e-ipp-b-b8bb1e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b8bb1e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b8bb1e-84466f94c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b8bb1e-84466f94c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b8bb1e-84466f94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b8bb1e: serviceaccount "payload-processing-e2e-ipp-b-b8bb1e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b8bb1e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-kchch

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b8bb1e-84466f94c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b8bb1e-84466f94c-pjkmm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-kchch

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b8bb1e-84466f94c-pjkmm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b8bb1e-84466f94c-pjkmm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-kchch

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-kchch

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-kchch

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b8bb1e-84466f94c-pjkmm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-b8bb1e-84466f94c-pjkmm

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

Unhealthy

Readiness probe failed: Get "http://10.132.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

ProbeError

Readiness probe error: Get "http://10.132.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3430f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3430f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3430f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3430f6-84fd4c6898 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3430f6: serviceaccount "payload-processing-e2e-ipp-a-3430f6" not found
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

ProbeError

Startup probe error: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

Unhealthy

Startup probe failed: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3430f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3430f6-759b46c687 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3430f6-84fd4c6898

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3430f6-84fd4c6898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3430f6: serviceaccount "payload-processing-e2e-ipp-a-3430f6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3430f6-84fd4c6898

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.29s (1.29s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ceba51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ceba51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.048s (2.048s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f91cd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f91cd1-7d754d98bb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-h696c

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f91cd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f91cd1-7d754d98bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f91cd1: serviceaccount "payload-processing-e2e-ipp-a-f91cd1" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f91cd1-7d754d98bb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f91cd1: serviceaccount "payload-processing-e2e-ipp-a-f91cd1" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-h696c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-h696c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-h696c

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-h696c

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.599s (1.599s including waiting). Image size: 166620835 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f91cd1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f91cd1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ceba51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ceba51-9776c4ffb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-vk52b
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ceba51-9776c4ffb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ceba51-9776c4ffb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ceba51: serviceaccount "payload-processing-e2e-ipp-a-ceba51" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ceba51: serviceaccount "payload-processing-e2e-ipp-a-ceba51" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ceba51-9776c4ffb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ceba51-9776c4ffb-vddkl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ceba51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-vk52b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-vk52b

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-ceba51-9776c4ffb-vddkl

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ceba51-9776c4ffb-vddkl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ceba51-9776c4ffb-vddkl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ceba51-9776c4ffb-vddkl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-vk52b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-vk52b

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7b4185

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7b4185

openshift-ingress

deployment-controller

e2e-ipp-b-7b4185-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7

SuccessfulCreate

Created pod: e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

openshift-ingress

kubelet

payload-processing-e2e-mt-146320d5-586748b797-k74kx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-146320d5-65b76f4b67-m9qg8

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

Unhealthy

Readiness probe failed: Get "http://10.133.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

ProbeError

Readiness probe error: Get "http://10.133.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7b4185

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7b4185-898d6c9df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7b4185-898d6c9df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7b4185: serviceaccount "payload-processing-e2e-ipp-b-7b4185" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7b4185-898d6c9df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7b4185-898d6c9df-fjswd

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7b4185

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7b4185-898d6c9df from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-jjpxl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7b4185: serviceaccount "payload-processing-e2e-ipp-b-7b4185" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-jjpxl

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-jjpxl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7b4185-898d6c9df-fjswd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-jjpxl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-jjpxl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7b4185-898d6c9df-fjswd

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-7b4185-898d6c9df-fjswd

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7b4185-898d6c9df-fjswd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f91cd1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3430f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3430f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f91cd1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a9b573

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a9b573

openshift-ingress

replicaset-controller

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f

SuccessfulCreate

Created pod: e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

openshift-ingress

deployment-controller

e2e-ipp-b-a9b573-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a9b573-openshift-default-7c6bb5767f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-801218-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-801218-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-9154a6-openshift-default-7f74d4f9bc

SuccessfulCreate

Created pod: e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

openshift-ingress

gateway_labeler_controller

e2e-api-b-9154a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9154a6

openshift-ingress

deployment-controller

e2e-api-b-9154a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9154a6-openshift-default-7f74d4f9bc from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ceba51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ceba51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a9b573-85d444bfdf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a9b573-85d444bfdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a9b573: serviceaccount "payload-processing-e2e-ipp-b-a9b573" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-r5kx6

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a9b573-85d444bfdf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a9b573-85d444bfdf-zzqlp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a9b573

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a9b573-85d444bfdf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a9b573: serviceaccount "payload-processing-e2e-ipp-b-a9b573" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a9b573

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-a9b573-85d444bfdf-zzqlp

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9b573-85d444bfdf-zzqlp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-r5kx6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9b573-85d444bfdf-zzqlp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-r5kx6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9b573-85d444bfdf-zzqlp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-r5kx6

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-r5kx6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9154a6-6cb7bfddbf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9154a6-6cb7bfddbf-mcqng
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9154a6-6cb7bfddbf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9154a6-6cb7bfddbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9154a6: serviceaccount "payload-processing-e2e-api-b-9154a6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9154a6-85c9f9448c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9154a6: serviceaccount "payload-processing-e2e-api-b-9154a6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9154a6-85c9f9448c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-d4pt4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9154a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9154a6-85c9f9448c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9154a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9154a6-6cb7bfddbf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-9154a6-6cb7bfddbf-mcqng

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-d4pt4

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-d4pt4

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9154a6-6cb7bfddbf-mcqng

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-d4pt4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-d4pt4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-9154a6-6cb7bfddbf-mcqng

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9154a6-6cb7bfddbf-mcqng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-801218-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-801218-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b8bb1e-8bfbcf887-kchch

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b8bb1e-84466f94c-pjkmm

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-146320d5-openshift-default-75cbf47c85-zhzlr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b8bb1e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b8bb1e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9154a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9154a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b8bb1e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b8bb1e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b8bb1e-6d9649764

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b8bb1e-6d9649764-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b8bb1e: serviceaccount "payload-processing-e2e-ipp-b-b8bb1e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b8bb1e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-427ss

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b8bb1e-6d9649764

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b8bb1e-6d9649764-p2b84
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b8bb1e: serviceaccount "payload-processing-e2e-ipp-b-b8bb1e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b8bb1e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b8bb1e-6d9649764 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-427ss

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b8bb1e-6d9649764-p2b84

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b8bb1e-6d9649764-p2b84

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-427ss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-427ss

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-b8bb1e-6d9649764-p2b84

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-427ss

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b8bb1e-6d9649764-p2b84

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-pwfbr

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-5shj7

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

ProbeError

Startup probe error: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7b4185-7848cfbf55-jjpxl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7b4185-898d6c9df-fjswd

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

Unhealthy

Startup probe failed: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-xln8x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-965f61-openshift-default-55854964c from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-l9h6r

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-rxktx

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-p5dsp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-bzbxb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-cqvwg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 8 to 7

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-jml8m

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9b573-6c9676dddc-r5kx6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9b573-85d444bfdf-zzqlp

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7b4185-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

Created

Container created
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7b4185-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 8 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-b4cdj

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-api-a-801218-5c988b64cf-w2d4l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-fsf4c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-801218-7bd7574847-2fgt5

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7b4185

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7b4185-cfcb87d66 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7b4185

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7b4185: serviceaccount "payload-processing-e2e-ipp-b-7b4185" not found
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

ProbeError

Startup probe error: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused body:
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7b4185-cfcb87d66

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7b4185-cfcb87d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7b4185: serviceaccount "payload-processing-e2e-ipp-b-7b4185" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7b4185-cfcb87d66

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7b4185-cfcb87d66-l8fzb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-jllqw
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

Unhealthy

Startup probe failed: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7b4185-cfcb87d66-l8fzb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7b4185-cfcb87d66-l8fzb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-jllqw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-7b4185-cfcb87d66-l8fzb

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-jllqw

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-jllqw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-jllqw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7b4185-cfcb87d66-l8fzb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-801218-openshift-default-58b4b8685c-8gpjq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9b573-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9b573-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9154a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9154a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a9b573

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a9b573-6c5c49445d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a9b573

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-9154a6-6cb7bfddbf-mcqng

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9154a6-85c9f9448c-d4pt4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-db98c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-l4cmb
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a9b573: serviceaccount "payload-processing-e2e-ipp-b-a9b573" not found
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a9b573-6c5c49445d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a9b573-6c5c49445d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a9b573: serviceaccount "payload-processing-e2e-ipp-b-a9b573" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a9b573-6c5c49445d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a9b573-6c5c49445d-j6qkq

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-l4cmb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-a9b573-6c5c49445d-j6qkq

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-l4cmb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9b573-6c5c49445d-j6qkq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9b573-6c5c49445d-j6qkq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-l4cmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-l4cmb

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9b573-6c5c49445d-j6qkq

Created

Container created

openshift-ingress

kubelet

e2e-api-b-9154a6-openshift-default-7f74d4f9bc-v6fc7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-ff43e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-ff43e3

openshift-ingress

replicaset-controller

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9

SuccessfulCreate

Created pod: e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

openshift-ingress

deployment-controller

e2e-ipp-a-ff43e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9b573-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9b573-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ff43e3-576df466d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ff43e3-576df466d7-4pqsr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ff43e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ff43e3-576df466d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-gz8bs
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ff43e3-576df466d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ff43e3-576df466d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ff43e3: serviceaccount "payload-processing-e2e-ipp-a-ff43e3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ff43e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ff43e3: serviceaccount "payload-processing-e2e-ipp-a-ff43e3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-gz8bs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ff43e3-576df466d7-4pqsr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-gz8bs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-gz8bs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-gz8bs

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ff43e3-576df466d7-4pqsr

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-ff43e3-576df466d7-4pqsr

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ff43e3-576df466d7-4pqsr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-ghc4c

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rgfnt

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-gd8rr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-5xqkc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3430f6-84fd4c6898-7rzjt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3430f6-759b46c687-rh2ks

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-3430f6-openshift-default-595d4f6b8c-ltm6g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ceba51-9776c4ffb-vddkl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ceba51-6c8fc9774c-vk52b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-ceba51-openshift-default-d46fffd85-jw942

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7b4185-cfcb87d66-l8fzb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7b4185-7c659d956c-jllqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9b573-75678d44f9-l4cmb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9b573-6c5c49445d-j6qkq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-7b4185-openshift-default-5cc48cbdb7-bczhp

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-9ee727-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-9ee727-openshift-default-745c55b44f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-9ee727-openshift-default-745c55b44f

SuccessfulCreate

Created pod: e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-c6859a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-c6859a

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-9ee727

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-9ee727

openshift-ingress

deployment-controller

e2e-praxis-a-c6859a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c6859a-openshift-default-6d77b94c97 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-c6859a-openshift-default-6d77b94c97

SuccessfulCreate

Created pod: e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

openshift-ingress

multus

e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-9ee727: serviceaccount "payload-processing-e2e-praxis-a-9ee727" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-9ee727: serviceaccount "payload-processing-e2e-praxis-a-9ee727" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-9ee727

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-qq7nn

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-9ee727

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-r5j4l

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-r5j4l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-qq7nn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-qq7nn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-r5j4l

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-qq7nn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-qq7nn

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-r5j4l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-r5j4l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ff43e3-5d974c979f-gz8bs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ff43e3-576df466d7-4pqsr

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-c6859a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-c6859a-5f796cd5cf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c6859a-5f796cd5cf

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c6859a: serviceaccount "payload-processing-e2e-praxis-a-c6859a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-c6859a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c6859a: serviceaccount "payload-processing-e2e-praxis-a-c6859a" not found

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d1d441

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d1d441

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-4r9lt

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c6859a-5f796cd5cf

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-gmshg

openshift-ingress

replicaset-controller

e2e-praxis-a-d1d441-openshift-default-c79997b97

SuccessfulCreate

Created pod: e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

openshift-ingress

deployment-controller

e2e-praxis-a-d1d441-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d1d441-openshift-default-c79997b97 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-gmshg

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-gmshg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-gmshg

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-a9b573-openshift-default-7c6bb5767f-tps4f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-gmshg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-4r9lt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-4r9lt

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-4r9lt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-4r9lt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-k2jb2

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2kmj4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-n6t9x
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d1d441-669694c87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d1d441-669694c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d1d441: serviceaccount "payload-processing-e2e-praxis-a-d1d441" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d1d441

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d1d441-588dbc6899 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d1d441-588dbc6899

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d1d441-588dbc6899

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d1d441-588dbc6899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d1d441: serviceaccount "payload-processing-e2e-praxis-a-d1d441" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d1d441

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d1d441-669694c87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d1d441-669694c87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ff43e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ff43e3-944445948 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ff43e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ff43e3-944445948

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ff43e3-944445948-ph2kl
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ff43e3-944445948

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ff43e3-944445948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ff43e3: serviceaccount "payload-processing-e2e-ipp-a-ff43e3" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-ttklw

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ff43e3: serviceaccount "payload-processing-e2e-ipp-a-ff43e3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-ttklw

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ff43e3-944445948-ph2kl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-ttklw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-ff43e3-944445948-ph2kl

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ff43e3-944445948-ph2kl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ff43e3-944445948-ph2kl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-ttklw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-ttklw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f91cd1-7f59958f95-c2qrv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f91cd1-7d754d98bb-h696c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-srnk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-p6f5x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-srnk2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-p6f5x
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-24cd29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-24cd29

openshift-ingress

kubelet

e2e-ipp-a-f91cd1-openshift-default-556cb85755-v94km

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9

SuccessfulCreate

Created pod: e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

openshift-ingress

deployment-controller

e2e-ipp-b-24cd29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

Created

Container created

openshift-ingress

multus

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9ee727-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9ee727-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c6859a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c6859a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ff43e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ff43e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-24cd29-69d9789c79

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-24cd29-69d9789c79-fh6c4
(x6)

openshift-ingress

kubelet

e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-b2hdr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-24cd29: serviceaccount "payload-processing-e2e-ipp-b-24cd29" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-24cd29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-24cd29-69d9789c79

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-24cd29-69d9789c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-24cd29: serviceaccount "payload-processing-e2e-ipp-b-24cd29" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-24cd29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-24cd29-69d9789c79 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24cd29-69d9789c79-fh6c4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-b2hdr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7

SuccessfulCreate

Created pod: e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

openshift-ingress

deployment-controller

e2e-praxis-b-b44631-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b44631-openshift-default-5bbbcc5f7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b44631

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b44631

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24cd29-69d9789c79-fh6c4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24cd29-69d9789c79-fh6c4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-24cd29-69d9789c79-fh6c4

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-b2hdr

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-b2hdr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-b2hdr

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-b-edc450-openshift-default-84c757994f

SuccessfulCreate

Created pod: e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-edc450

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-edc450

openshift-ingress

deployment-controller

e2e-praxis-b-edc450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-edc450-openshift-default-84c757994f from 0 to 1

openshift-ingress

multus

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b44631

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b44631-8456d66fbf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b44631-6b47595bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-b7rtc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b44631

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b44631-6b47595bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b44631-8456d66fbf

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b44631-8456d66fbf-kb6zn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b44631-8456d66fbf

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b44631-8456d66fbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b44631: serviceaccount "payload-processing-e2e-praxis-b-b44631" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b44631-6b47595bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b44631: serviceaccount "payload-processing-e2e-praxis-b-b44631" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-b7rtc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-b7rtc

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b44631-8456d66fbf-kb6zn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-b7rtc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-b7rtc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b44631-8456d66fbf-kb6zn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-b44631-8456d66fbf-kb6zn

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b44631-8456d66fbf-kb6zn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-edc450

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-edc450-8c5754587

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-edc450-8c5754587-sfsfv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-edc450: serviceaccount "payload-processing-e2e-praxis-b-edc450" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-jnjrl

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-edc450

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-edc450-8c5754587 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-edc450-8c5754587

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-edc450-8c5754587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-edc450: serviceaccount "payload-processing-e2e-praxis-b-edc450" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-edc450-8c5754587-sfsfv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-edc450-8c5754587-sfsfv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-jnjrl

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-jnjrl

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-edc450-8c5754587-sfsfv

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-jnjrl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-jnjrl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-edc450-8c5754587-sfsfv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b8bb1e-6d9649764-p2b84

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b8bb1e-74c8bd9999-427ss

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7

SuccessfulCreate

Created pod: e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

openshift-ingress

deployment-controller

e2e-praxis-b-81c810-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-81c810-openshift-default-5fbd5b64c7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-81c810

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-81c810

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b44631-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b44631-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-81c810: serviceaccount "payload-processing-e2e-praxis-b-81c810" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-k862v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-81c810

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-81c810

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-81c810-5749ff85ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-81c810-5749ff85ff

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-81c810-5749ff85ff-5fr52
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-81c810-5749ff85ff

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-81c810-5749ff85ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-81c810: serviceaccount "payload-processing-e2e-praxis-b-81c810" not found
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-k862v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-k862v

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-81c810-5749ff85ff-5fr52

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-k862v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-k862v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-81c810-5749ff85ff-5fr52

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-81c810-5749ff85ff-5fr52

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-81c810-5749ff85ff-5fr52

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9ee727-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-b8bb1e-openshift-default-557bbf897c-phbbm

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9ee727-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c6859a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c6859a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-a-b3ca79-openshift-default-745989d85

SuccessfulCreate

Created pod: e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

openshift-ingress

deployment-controller

e2e-praxis-a-b3ca79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b3ca79-openshift-default-745989d85 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-b3ca79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b3ca79
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-81c810-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-81c810-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-b3ca79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-b3ca79-776b5db7b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-t4295
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b3ca79: serviceaccount "payload-processing-e2e-praxis-a-b3ca79" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-b3ca79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b3ca79-776b5db7b5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b3ca79: serviceaccount "payload-processing-e2e-praxis-a-b3ca79" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b3ca79-776b5db7b5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-8f4k2

openshift-ingress

multus

payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-8f4k2

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-8f4k2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d1d441-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-8f4k2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-t4295

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-t4295

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d1d441-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-t4295

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-t4295

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-8f4k2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

Unhealthy

Startup probe failed: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

ProbeError

Startup probe error: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24cd29-69d9789c79-fh6c4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24cd29-6d745d66c9-b2hdr

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-24cd29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-24cd29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d1d441-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d1d441-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

Unhealthy

Readiness probe failed: Get "http://10.132.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

ProbeError

Readiness probe error: Get "http://10.132.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

ProbeError

Readiness probe error: Get "http://10.133.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

Unhealthy

Readiness probe failed: Get "http://10.133.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9ee727-7f9ccf9d5-r5j4l

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9ee727-d7d75f767-qq7nn

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-24cd29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-24cd29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

Unhealthy

Startup probe failed: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

ProbeError

Startup probe error: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

Unhealthy

Startup probe failed: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

ProbeError

Startup probe error: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c6859a-59d59469c9-4r9lt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c6859a-5f796cd5cf-gmshg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-9ee727-openshift-default-745c55b44f-z5w2g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-edc450-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-edc450-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-24cd29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-24cd29-5c5cb6887b from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-24cd29: serviceaccount "payload-processing-e2e-ipp-b-24cd29" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-24cd29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-24cd29-5c5cb6887b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-24cd29: serviceaccount "payload-processing-e2e-ipp-b-24cd29" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-chxzf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-24cd29-5c5cb6887b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-chxzf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-qfvwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-chxzf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-chxzf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-chxzf

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-qfvwr

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-qfvwr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-qfvwr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-qfvwr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b44631-8456d66fbf-kb6zn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b44631-6b47595bc-b7rtc

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-81c810-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-81c810-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b44631-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b44631-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-b44631-openshift-default-5bbbcc5f7-896p8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-b-7cf9ef-openshift-default-757899c4f

SuccessfulCreate

Created pod: e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

openshift-ingress

multus

e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-7cf9ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-7cf9ef

openshift-ingress

deployment-controller

e2e-praxis-b-7cf9ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-7cf9ef-openshift-default-757899c4f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-7cf9ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-7cf9ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-srt2f
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-7cf9ef: serviceaccount "payload-processing-e2e-praxis-b-7cf9ef" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-5cpz6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-7cf9ef: serviceaccount "payload-processing-e2e-praxis-b-7cf9ef" not found
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-5cpz6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-srt2f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-5cpz6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-srt2f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-5cpz6

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-5cpz6

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-srt2f

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-srt2f

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3ca79-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3ca79-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ff43e3-67d8bf5499-ttklw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ff43e3-944445948-ph2kl

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-edc450-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-edc450-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-c6859a-openshift-default-6d77b94c97-s7ld8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-ff43e3-openshift-default-6bcc4fdd9-wt9wd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3ca79-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3ca79-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-edc450-8c5754587-sfsfv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-edc450-7b5666bb59-jnjrl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 5 to 10
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-rmcgf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 6 to 5

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24cd29-67c5899cb7-qfvwr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24cd29-5c5cb6887b-chxzf

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-965f61-openshift-default-55854964c from 6 to 5

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-6rs9r
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

ProbeError

Startup probe error: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

Unhealthy

Startup probe failed: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-zlcr5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-e37d27

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-e37d27

openshift-ingress

kubelet

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-praxis-a-e37d27-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e37d27-openshift-default-576b58b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-e37d27-openshift-default-576b58b5

SuccessfulCreate

Created pod: e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

openshift-ingress

kubelet

e2e-ipp-b-24cd29-openshift-default-6c7dfb89d9-plhmn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-praxis-a-d1d441-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d1d441-openshift-default-c79997b97 from 1 to 2

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-d1d441-openshift-default-c79997b97

SuccessfulCreate

Created pod: e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d1d441-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-edc450-openshift-default-84c757994f-q4vwz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-96rgs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-e37d27

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e37d27: serviceaccount "payload-processing-e2e-praxis-a-e37d27" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-e37d27

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e37d27: serviceaccount "payload-processing-e2e-praxis-a-e37d27" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-gb52r

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-gb52r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

Unhealthy

Startup probe failed: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-gb52r

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

ProbeError

Startup probe error: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-gb52r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-gb52r

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-vmr64

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-rnr8g
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b3ca79-776b5db7b5-8f4k2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b3ca79-6f8bf456dc-t4295

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-965f61-openshift-default-55854964c from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-g99lj

openshift-ingress

kubelet

e2e-praxis-a-b3ca79-openshift-default-745989d85-6nszj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7cf9ef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7cf9ef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7cf9ef-699d468f47-5cpz6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7cf9ef-7b7cbd9689-srt2f

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7cf9ef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7cf9ef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5

SuccessfulCreate

Created pod: e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-e6a0de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-e6a0de

openshift-ingress

deployment-controller

e2e-praxis-b-e6a0de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-e6a0de-openshift-default-856c98d7d5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-7cf9ef-openshift-default-757899c4f-ht8jr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-e6a0de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-e6a0de-5b64759d6c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e6a0de: serviceaccount "payload-processing-e2e-praxis-b-e6a0de" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-e6a0de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-4mxw7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e6a0de-5b64759d6c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e6a0de: serviceaccount "payload-processing-e2e-praxis-b-e6a0de" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e6a0de-5b64759d6c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-qqgln

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-qqgln

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-4mxw7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-4mxw7

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-4mxw7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-qqgln

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-qqgln

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-4mxw7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-qqgln

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

Created

Container created

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

Started

Container started

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

ProbeError

Readiness probe error: Get "http://10.132.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

Unhealthy

Readiness probe failed: Get "http://10.132.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

ProbeError

Startup probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

Unhealthy

Startup probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

ProbeError

Readiness probe error: Get "http://10.132.0.192:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

ProbeError

Readiness probe error: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

Unhealthy

Readiness probe failed: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

Unhealthy

Readiness probe failed: Get "http://10.132.0.192:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

Unhealthy

Readiness probe failed: Get "http://10.133.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-mprn9

Unhealthy

Readiness probe failed: Get "https://10.132.0.46:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

ProbeError

Readiness probe error: Get "http://10.133.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

ProbeError

Readiness probe error: Get "http://10.132.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

Unhealthy

Readiness probe failed: Get "http://10.132.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

Created

Container created

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e37d27-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e37d27-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

ProbeError

Readiness probe error: Get "http://10.132.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

Unhealthy

Readiness probe failed: Get "http://10.132.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e37d27-6ddbbfbc47-gb52r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e37d27-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e37d27-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulCreate

Created pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

Started

Container started

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

AddedInterface

Add eth0 [10.132.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-d7npm

Unhealthy

Readiness probe failed: Get "https://10.133.0.34:8000/ready": context deadline exceeded
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e6a0de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e6a0de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e37d27-c8547cdf9-v856h

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.203:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d1d441-669694c87-fhkbx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d1d441-588dbc6899-4rnfz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

ProbeError

Startup probe error: Get "http://10.132.0.223:15021/healthz/ready": dial tcp 10.132.0.223:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

Unhealthy

Startup probe failed: Get "http://10.132.0.223:15021/healthz/ready": dial tcp 10.132.0.223:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

ProbeError

Startup probe error: Get "http://10.132.0.225:15021/healthz/ready": dial tcp 10.132.0.225:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

Unhealthy

Startup probe failed: Get "http://10.132.0.225:15021/healthz/ready": dial tcp 10.132.0.225:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c

SuccessfulCreate

Created pod: e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-a-w2-c9707f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-c9707f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-c9707f

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-84mqf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-d1d441-openshift-default-c79997b97-7gslz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e6a0de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e6a0de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-e37d27-openshift-default-576b58b5-kk62f

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c9707f: serviceaccount "payload-processing-e2e-shared-a-w2-c9707f" not found

openshift-ingress

deployment-controller

e2e-shared-a-w3-338f2e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-338f2e-openshift-default-67bb4686c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c

SuccessfulCreate

Created pod: e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-c9707f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-c9707f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-c9707f-5d5859459c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c9707f: serviceaccount "payload-processing-e2e-shared-a-w2-c9707f" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-338f2e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-338f2e

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn

Started

Container started

openshift-ingress

multus

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-81c810-666bd7cfc5-k862v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-81c810-5749ff85ff-5fr52

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-338f2e: serviceaccount "payload-processing-e2e-shared-a-w3-338f2e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-338f2e: serviceaccount "payload-processing-e2e-shared-a-w3-338f2e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-338f2e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-338f2e-57f7757bf from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-a-w4-57dc6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e6a0de-5b64759d6c-qqgln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e6a0de-5987ffc46c-4mxw7

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-338f2e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c

SuccessfulCreate

Created pod: e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-57dc6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-57dc6d

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-wmkf5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-gnfkb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 8 to 6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-57dc6d: serviceaccount "payload-processing-e2e-shared-a-w4-57dc6d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-57dc6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-57dc6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-57dc6d: serviceaccount "payload-processing-e2e-shared-a-w4-57dc6d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-fnhnx

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fnhnx

Killing

Stopping container discovery

openshift-ingress

kubelet

e2e-praxis-b-81c810-openshift-default-5fbd5b64c7-kbvbk

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-c9707f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-c9707f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-e6a0de-openshift-default-856c98d7d5-9pq9s

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-031745

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-031745

openshift-ingress

deployment-controller

e2e-shared-b-w2-031745-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-031745-openshift-default-7f667bc645 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulCreate

Created pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-77a153

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-77a153

openshift-ingress

deployment-controller

e2e-shared-a-w1-77a153-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-77a153-openshift-default-7778f45d97 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-77a153-openshift-default-7778f45d97

SuccessfulCreate

Created pod: e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

openshift-ingress

multus

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7

SuccessfulCreate

Created pod: e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

openshift-ingress

deployment-controller

e2e-shared-b-w3-b2a372-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-b2a372-openshift-default-b75db95f7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-b2a372

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-b2a372

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-031745

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

Unhealthy

Startup probe failed: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

ProbeError

Startup probe error: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-031745

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-031745: serviceaccount "payload-processing-e2e-shared-b-w2-031745" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-031745: serviceaccount "payload-processing-e2e-shared-b-w2-031745" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9

AddedInterface

Add eth0 [10.132.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-77a153

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-77a153-6c975c99f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-77a153: serviceaccount "payload-processing-e2e-shared-a-w1-77a153" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-77a153

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-77a153: serviceaccount "payload-processing-e2e-shared-a-w1-77a153" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-b2a372

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-b2a372

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b2a372: serviceaccount "payload-processing-e2e-shared-b-w3-b2a372" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b2a372: serviceaccount "payload-processing-e2e-shared-b-w3-b2a372" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w4-9633f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-9633f0-openshift-default-84b674487f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-9633f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-9633f0

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9633f0-openshift-default-84b674487f

SuccessfulCreate

Created pod: e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7

Created

Container created

openshift-ingress

multus

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-9633f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-9633f0-6b8776566f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-9633f0: serviceaccount "payload-processing-e2e-shared-b-w4-9633f0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-9633f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-7229f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-7229f2

openshift-ingress

deployment-controller

e2e-autores-7229f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-7229f2-openshift-default-7b5c69df47 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-autores-7229f2-openshift-default-7b5c69df47

SuccessfulCreate

Created pod: e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-9633f0: serviceaccount "payload-processing-e2e-shared-b-w4-9633f0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7

Created

Container created

openshift-ingress

multus

e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

Unhealthy

Readiness probe failed: Get "http://10.132.0.228:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

ProbeError

Readiness probe error: Get "http://10.132.0.228:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7229f2-798cdf44cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-7229f2-798cdf44cf-4wm7j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7229f2-798cdf44cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-7229f2-798cdf44cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7229f2: serviceaccount "payload-processing-e2e-autores-7229f2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-7229f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-7229f2-7b7cfc846f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-7229f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-7229f2-798cdf44cf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7229f2-7b7cfc846f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-7229f2-7b7cfc846f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7229f2: serviceaccount "payload-processing-e2e-autores-7229f2" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-7229f2-7b7cfc846f-4h24n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-7229f2-7b7cfc846f-4h24n

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-57dc6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-57dc6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7229f2-7b7cfc846f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-7229f2-7b7cfc846f-4h24n

openshift-ingress

kubelet

payload-processing-e2e-autores-7229f2-7b7cfc846f-4h24n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-7229f2-7b7cfc846f-4h24n

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-autores-7229f2-798cdf44cf-4wm7j

AddedInterface

Add eth0 [10.132.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7229f2-798cdf44cf-4wm7j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7229f2-798cdf44cf-4wm7j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7229f2-798cdf44cf-4wm7j

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-c9707f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-c9707f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

ProbeError

Startup probe error: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

Unhealthy

Startup probe failed: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

ProbeError

Startup probe error: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

Unhealthy

Startup probe failed: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-77a153-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-77a153-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-x829c

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

AddedInterface

Add eth0 [10.132.0.246/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-965f61-openshift-default-55854964c from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-895sj

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-895sj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-x829c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-x829c

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-895sj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-x829c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-895sj

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-x829c

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

AddedInterface

Add eth0 [10.132.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-895sj

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-895sj

Unhealthy

Startup probe failed: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-895sj

ProbeError

Startup probe error: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulCreate

Created pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulCreate

Created pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

openshift-ingress

multus

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

Created

Container created

openshift-ingress

multus

e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulCreate

Created pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w2-031745-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-031745-openshift-default-7f667bc645 from 1 to 4
(x9)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

ProbeError

Startup probe error: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

ProbeError

Startup probe error: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-x829c

ProbeError

Startup probe error: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-x829c

Unhealthy

Startup probe failed: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

Unhealthy

Startup probe failed: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

Unhealthy

Startup probe failed: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

Unhealthy

Readiness probe failed: Get "http://10.132.0.234:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

ProbeError

Readiness probe error: Get "http://10.132.0.234:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulCreate

Created pod: e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

Unhealthy

Startup probe failed: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

ProbeError

Startup probe error: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w1-d6ac82-openshift-default-56596855f

SuccessfulCreate

Created pod: e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

openshift-ingress

deployment-controller

e2e-shared-b-w1-d6ac82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-d6ac82-openshift-default-56596855f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-d6ac82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-d6ac82
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-338f2e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-338f2e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-d6ac82: serviceaccount "payload-processing-e2e-shared-b-w1-d6ac82" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-d6ac82: serviceaccount "payload-processing-e2e-shared-b-w1-d6ac82" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-d6ac82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-d6ac82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-d6ac82-75d47769c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-57dc6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-57dc6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

ProbeError

Readiness probe error: Get "http://10.132.0.243:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

Unhealthy

Readiness probe failed: Get "http://10.132.0.243:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

ProbeError

Readiness probe error: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7229f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7229f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

Unhealthy

Readiness probe failed: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

Unhealthy

Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

ProbeError

Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

ProbeError

Startup probe error: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

Unhealthy

Startup probe failed: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

Unhealthy

Startup probe failed: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

ProbeError

Startup probe error: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulCreate

Created pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

ProbeError

Startup probe error: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulCreate

Created pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

Unhealthy

Startup probe failed: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w2-031745-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-031745-openshift-default-7f667bc645 from 4 to 6

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm

Created

Container created

openshift-ingress

multus

e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

Created

Container created

openshift-ingress

multus

e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b4nmd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-b4nmd
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-b2a372-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm

Unhealthy

Startup probe failed: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm

ProbeError

Startup probe error: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-b2a372-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q2f45

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-b2a372-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-b2a372-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9633f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9633f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-77a153-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-77a153-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7229f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7229f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

Unhealthy

Startup probe failed: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

ProbeError

Startup probe error: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d6ac82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d6ac82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d6ac82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d6ac82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-a-w1-77a153-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-77a153-openshift-default-7778f45d97 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w1-77a153-openshift-default-7778f45d97

SuccessfulCreate

Created pod: e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-77a153-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7

SuccessfulCreate

Created pod: e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

openshift-ingress

deployment-controller

e2e-shared-b-w3-b2a372-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-b2a372-openshift-default-b75db95f7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-b2a372-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

Unhealthy

Startup probe failed: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

ProbeError

Startup probe error: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-7229f2-7b7cfc846f-4h24n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7229f2-798cdf44cf-4wm7j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-7229f2-openshift-default-7b5c69df47-7tnqr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-575fe8-openshift-default-85c4b685b5

SuccessfulCreate

Created pod: e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

openshift-ingress

gateway_labeler_controller

e2e-noten-575fe8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-575fe8

openshift-ingress

deployment-controller

e2e-noten-575fe8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-575fe8-openshift-default-85c4b685b5 from 0 to 1

openshift-ingress

kubelet

e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

Started

Container started

openshift-ingress

kubelet

e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

Created

Container created

openshift-ingress

multus

e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

AddedInterface

Add eth0 [10.132.1.2/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-575fe8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-575fe8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-575fe8-openshift-default-85c4b685b5-sznbb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-xmpnp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-mxtf8

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-d5gfx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-dw4vw

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7096-a211b5

Created

Container created

opendatahub

multus

test-curl-7096-a211b5

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7096-a211b5

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7096-a211b5

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 10 to 9

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

opendatahub

kubelet

test-curl-7096-f899c2

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-zs49c

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

opendatahub

multus

test-curl-7096-f899c2

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7096-f899c2

Created

Container created

opendatahub

kubelet

test-curl-7096-a211b5

Killing

Stopping container test-curl-7096-a211b5

opendatahub

kubelet

test-curl-7096-f899c2

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-766728

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-766728

openshift-ingress

deployment-controller

e2e-shared-a-w0-766728-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-766728-openshift-default-647554f999 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-766728-openshift-default-647554f999

SuccessfulCreate

Created pod: e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

opendatahub

kubelet

test-curl-7096-f899c2

Killing

Stopping container test-curl-7096-f899c2

openshift-ingress

multus

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

AddedInterface

Add eth0 [10.132.1.3/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-766728-d66dffc49

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-766728

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-766728-d66dffc49 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-766728: serviceaccount "payload-processing-e2e-shared-a-w0-766728" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-766728-d66dffc49

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-766728-d66dffc49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-766728: serviceaccount "payload-processing-e2e-shared-a-w0-766728" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-766728

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kcm76

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bpdkc

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-9tntx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-b2a372-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w3-b2a372-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-b2a372-openshift-default-b75db95f7 from 2 to 3

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7

SuccessfulCreate

Created pod: e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 8 to 5

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-rw9sz
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-wq9cv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-rvcxf

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-cjmdq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-crjjl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-crjjl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7108-c55018

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7108-c55018

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7108-c55018

Created

Container created

opendatahub

kubelet

test-curl-7108-c55018

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 983ms (983ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7108-c55018

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-bgh5f

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7108-0d3be9

Started

Container started

opendatahub

kubelet

test-curl-7108-0d3be9

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mrx9s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

test-curl-7108-0d3be9

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7108-0d3be9

Created

Container created

opendatahub

kubelet

test-curl-7108-c55018

Killing

Stopping container test-curl-7108-c55018

opendatahub

kubelet

test-curl-7108-e075d1

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7108-0d3be9

Killing

Stopping container test-curl-7108-0d3be9

opendatahub

multus

test-curl-7108-e075d1

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7108-e075d1

Created

Container created

opendatahub

kubelet

test-curl-7108-e075d1

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-crdbv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-m8x2n

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-nggns

opendatahub

multus

test-curl-7108-535368

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7108-535368

Created

Container created

opendatahub

kubelet

test-curl-7108-535368

Started

Container started

opendatahub

kubelet

test-curl-7108-535368

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7108-e075d1

Killing

Stopping container test-curl-7108-e075d1

opendatahub

kubelet

test-curl-7108-535368

Killing

Stopping container test-curl-7108-535368

openshift-ingress

deployment-controller

e2e-extmod-a-654741-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-654741-openshift-default-8449896d9c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-654741

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-654741

openshift-ingress

replicaset-controller

e2e-extmod-a-654741-openshift-default-8449896d9c

SuccessfulCreate

Created pod: e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

openshift-ingress

multus

e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-654741-785568f87c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-654741-785568f87c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-654741-785568f87c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-654741: serviceaccount "payload-processing-e2e-extmod-a-654741" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-654741: serviceaccount "payload-processing-e2e-extmod-a-654741" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-654741

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-654741-785568f87c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-654741

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-afc519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-afc519-openshift-default-dfdbf9b97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-afc519

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-afc519

openshift-ingress

replicaset-controller

e2e-extmod-a-afc519-openshift-default-dfdbf9b97

SuccessfulCreate

Created pod: e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

openshift-ingress

replicaset-controller

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c

SuccessfulCreate

Created pod: e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-57dc6d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w4-57dc6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c from 1 to 2

openshift-ingress

multus

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-afc519-d746ff6cc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-afc519-d746ff6cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-afc519: serviceaccount "payload-processing-e2e-extmod-a-afc519" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-afc519-d746ff6cc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-afc519: serviceaccount "payload-processing-e2e-extmod-a-afc519" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-afc519

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-afc519-d746ff6cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-afc519

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-afc519-69cbc98467 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

ProbeError

Startup probe error: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

Unhealthy

Startup probe failed: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-zmth9
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-895sj

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-bpgxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-895sj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-2vsk6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

ProbeError

Startup probe error: Get "http://10.132.1.3:15021/healthz/ready": dial tcp 10.132.1.3:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

Unhealthy

Startup probe failed: Get "http://10.132.1.3:15021/healthz/ready": dial tcp 10.132.1.3:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-qvp6h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-zmth9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-401761

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-401761

openshift-ingress

replicaset-controller

e2e-extmod-a-401761-openshift-default-6cdf858b5

SuccessfulCreate

Created pod: e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

openshift-ingress

deployment-controller

e2e-extmod-a-401761-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-401761-openshift-default-6cdf858b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-25f56e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-25f56e

openshift-ingress

replicaset-controller

e2e-shared-b-w0-25f56e-openshift-default-6465df847

SuccessfulCreate

Created pod: e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

openshift-ingress

deployment-controller

e2e-shared-b-w0-25f56e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-25f56e-openshift-default-6465df847 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-401761

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-401761-6ddf8dc4bf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-401761

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-401761: serviceaccount "payload-processing-e2e-extmod-a-401761" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-401761: serviceaccount "payload-processing-e2e-extmod-a-401761" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-25f56e: serviceaccount "payload-processing-e2e-shared-b-w0-25f56e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-25f56e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-25f56e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-f29tj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-tlqzm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-25f56e: serviceaccount "payload-processing-e2e-shared-b-w0-25f56e" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-766728-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-766728-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9x5tt

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7099-0a9981

Created

Container created

opendatahub

kubelet

test-curl-7099-0a9981

Started

Container started

opendatahub

multus

test-curl-7099-0a9981

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7099-0a9981

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

opendatahub

kubelet

test-curl-7099-0a9981

Killing

Stopping container test-curl-7099-0a9981
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-766728-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-766728-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zw5nk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-extmod-b-ded435-openshift-default-6c5655ff69

SuccessfulCreate

Created pod: e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

openshift-ingress

deployment-controller

e2e-extmod-b-ded435-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-ded435-openshift-default-6c5655ff69 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-ded435

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-ded435

openshift-ingress

gateway_labeler_controller

e2e-explicit-99ca0c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-99ca0c

openshift-ingress

multus

e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

AddedInterface

Add eth0 [10.132.1.14/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-99ca0c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-99ca0c-openshift-default-6d8f9b55fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc

SuccessfulCreate

Created pod: e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

openshift-ingress

multus

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

AddedInterface

Add eth0 [10.132.1.15/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-99ca0c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-99ca0c-568c687f79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-99ca0c-568c687f79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-99ca0c-568c687f79-tqpf6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-99ca0c-568c687f79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-99ca0c-568c687f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-99ca0c: serviceaccount "payload-processing-e2e-explicit-99ca0c" not found
(x2)

openshift-ingress

kubelet

e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-99ca0c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-99ca0c-787d86f4c5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-99ca0c-787d86f4c5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-99ca0c-787d86f4c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-99ca0c: serviceaccount "payload-processing-e2e-explicit-99ca0c" not found
(x2)

openshift-ingress

kubelet

e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-explicit-99ca0c-787d86f4c5-rhkjg

AddedInterface

Add eth0 [10.132.1.17/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-99ca0c-787d86f4c5-rhkjg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-99ca0c-568c687f79-tqpf6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-99ca0c-787d86f4c5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-99ca0c-787d86f4c5-rhkjg

openshift-ingress

multus

payload-pre-processing-e2e-explicit-99ca0c-568c687f79-tqpf6

AddedInterface

Add eth0 [10.132.1.16/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-99ca0c-568c687f79-tqpf6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-99ca0c-568c687f79-tqpf6

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-ded435

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-ded435-5cbbf45d4c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-ded435

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-99ca0c-787d86f4c5-rhkjg

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-ded435: serviceaccount "payload-processing-e2e-extmod-b-ded435" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-99ca0c-787d86f4c5-rhkjg

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-ded435: serviceaccount "payload-processing-e2e-extmod-b-ded435" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc

AddedInterface

Add eth0 [10.132.1.19/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-a99f2a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-a99f2a
(x5)

openshift-ingress

kubelet

e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-b-a99f2a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a99f2a-openshift-default-77649d68d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-a99f2a-openshift-default-77649d68d5

SuccessfulCreate

Created pod: e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk
(x5)

openshift-ingress

kubelet

e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk

AddedInterface

Add eth0 [10.132.1.20/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-654741-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-654741-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a99f2a-5bb987db5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-a99f2a-5bb987db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a99f2a: serviceaccount "payload-processing-e2e-extmod-b-a99f2a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a99f2a: serviceaccount "payload-processing-e2e-extmod-b-a99f2a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-a99f2a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-a99f2a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-a99f2a-5bb987db5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a99f2a-5bb987db5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694

AddedInterface

Add eth0 [10.132.1.21/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d

AddedInterface

Add eth0 [10.132.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-afc519-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-afc519-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df

SuccessfulCreate

Created pod: e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-567ca6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-567ca6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-654741-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-567ca6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-567ca6-openshift-default-74bf9cd4df from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-654741-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

AddedInterface

Add eth0 [10.132.1.23/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-8973e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-8973e2

openshift-ingress

deployment-controller

e2e-extmod-a-8973e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-8973e2-openshift-default-6bd79597f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-8973e2-openshift-default-6bd79597f7

SuccessfulCreate

Created pod: e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

openshift-ingress

multus

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

AddedInterface

Add eth0 [10.132.1.24/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-567ca6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-567ca6-86cc9d6977 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

AddedInterface

Add eth0 [10.132.1.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-567ca6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-567ca6-86cc9d6977

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-567ca6-86cc9d6977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-567ca6: serviceaccount "payload-processing-e2e-extmod-b-567ca6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-567ca6-86cc9d6977

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-567ca6: serviceaccount "payload-processing-e2e-extmod-b-567ca6" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8973e2: serviceaccount "payload-processing-e2e-extmod-a-8973e2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-8973e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-8973e2-849bd8687 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-8973e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8973e2-849bd8687

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-8973e2-849bd8687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8973e2: serviceaccount "payload-processing-e2e-extmod-a-8973e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8973e2-849bd8687

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2
(x2)

openshift-ingress

kubelet

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh

AddedInterface

Add eth0 [10.132.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-afc519-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-afc519-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

ProbeError

Startup probe error: Get "http://10.132.1.10:15021/healthz/ready": dial tcp 10.132.1.10:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

Unhealthy

Startup probe failed: Get "http://10.132.1.10:15021/healthz/ready": dial tcp 10.132.1.10:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

ProbeError

Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

Unhealthy

Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-25f56e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-25f56e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8973e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8973e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-401761-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-401761-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-25f56e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-25f56e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ded435-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ded435-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-99ca0c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-99ca0c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

Unhealthy

Startup probe failed: Get "http://10.132.1.15:15021/healthz/ready": dial tcp 10.132.1.15:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

ProbeError

Startup probe error: Get "http://10.132.1.15:15021/healthz/ready": dial tcp 10.132.1.15:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

ProbeError

Startup probe error: Get "http://10.132.1.14:15021/healthz/ready": dial tcp 10.132.1.14:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

Unhealthy

Startup probe failed: Get "http://10.132.1.14:15021/healthz/ready": dial tcp 10.132.1.14:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ded435-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ded435-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-99ca0c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-99ca0c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

Unhealthy

Readiness probe failed: Get "http://10.132.1.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

ProbeError

Readiness probe error: Get "http://10.132.1.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

Unhealthy

Startup probe failed: Get "http://10.132.1.23:15021/healthz/ready": dial tcp 10.132.1.23:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

ProbeError

Startup probe error: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

Unhealthy

Startup probe failed: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

ProbeError

Startup probe error: Get "http://10.132.1.23:15021/healthz/ready": dial tcp 10.132.1.23:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-567ca6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-567ca6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk

Unhealthy

Startup probe failed: Get "http://10.132.1.20:15021/healthz/ready": dial tcp 10.132.1.20:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk

ProbeError

Startup probe error: Get "http://10.132.1.20:15021/healthz/ready": dial tcp 10.132.1.20:15021: connect: connection refused body:
(x8)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-4l8fz

Killing

Stopping container istio-proxy
(x10)

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 4 to 3

openshift-ingress

replicaset-controller

e2e-extmod-b-227c93-openshift-default-74bc588c4f

SuccessfulCreate

Created pod: e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

openshift-ingress

deployment-controller

e2e-extmod-b-227c93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-227c93-openshift-default-74bc588c4f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-227c93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-227c93

openshift-ingress

multus

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

AddedInterface

Add eth0 [10.132.1.31/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-567ca6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-567ca6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-5dzkf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-227c93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-227c93-74b5c495fc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-227c93-74b5c495fc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-227c93-74b5c495fc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-227c93-74b5c495fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-227c93: serviceaccount "payload-processing-e2e-extmod-b-227c93" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-227c93: serviceaccount "payload-processing-e2e-extmod-b-227c93" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-227c93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8973e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2

AddedInterface

Add eth0 [10.132.1.32/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8973e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a99f2a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a99f2a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-99ca0c-568c687f79-tqpf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-99ca0c-787d86f4c5-rhkjg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-99ca0c-openshift-default-6d8f9b55fc-4cpsp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-47c409-openshift-default-796cbb7889

SuccessfulCreate

Created pod: e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

openshift-ingress

deployment-controller

e2e-extmod-a-47c409-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-47c409-openshift-default-796cbb7889 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-47c409

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-47c409

openshift-ingress

multus

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

AddedInterface

Add eth0 [10.132.1.35/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w2-031745-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-031745-openshift-default-7f667bc645 from 6 to 5

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-rs8fm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-47c409-d86754547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-47c409-d86754547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-47c409: serviceaccount "payload-processing-e2e-extmod-a-47c409" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-47c409-8649bf6df7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-47c409-8649bf6df7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-47c409: serviceaccount "payload-processing-e2e-extmod-a-47c409" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-47c409-8649bf6df7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-47c409

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-47c409-8649bf6df7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-47c409

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-47c409-d86754547 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-47c409-d86754547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk

AddedInterface

Add eth0 [10.132.1.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

Unhealthy

Startup probe failed: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

ProbeError

Startup probe error: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-5qzmk

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-965f61-openshift-default-55854964c from 5 to 3
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-227c93-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-c7gdx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-227c93-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w2-031745-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-031745-openshift-default-7f667bc645 from 5 to 4

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-56nq7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-b2a372-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-f2cvt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-b2a372-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-b2a372-openshift-default-b75db95f7 from 3 to 2
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-227c93-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-227c93-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-a04e4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a04e4e-openshift-default-6fbf97c57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57

SuccessfulCreate

Created pod: e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-a04e4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-a04e4e

openshift-ingress

multus

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

AddedInterface

Add eth0 [10.132.1.44/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

ProbeError

Readiness probe error: Get "http://10.132.1.35:15021/healthz/ready": read tcp 10.132.0.2:38192->10.132.1.35:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

Unhealthy

Readiness probe failed: Get "http://10.132.1.35:15021/healthz/ready": read tcp 10.132.0.2:38192->10.132.1.35:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-a04e4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-a04e4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a04e4e: serviceaccount "payload-processing-e2e-extmod-b-a04e4e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a04e4e: serviceaccount "payload-processing-e2e-extmod-b-a04e4e" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

Unhealthy

Startup probe failed: Get "http://10.132.1.35:15021/healthz/ready": dial tcp 10.132.1.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

ProbeError

Startup probe error: Get "http://10.132.1.35:15021/healthz/ready": dial tcp 10.132.1.35:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-47c409-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-47c409-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-47c409-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-47c409-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df

SuccessfulCreate

Created pod: e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

openshift-ingress

deployment-controller

e2e-extmod-b-567ca6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-567ca6-openshift-default-74bf9cd4df from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-s44tp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-031745-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-031745-openshift-default-7f667bc645 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-567ca6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-g57ts

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

Unhealthy

Startup probe failed: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

ProbeError

Startup probe error: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

Unhealthy

Readiness probe failed: Get "http://10.132.1.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

ProbeError

Readiness probe error: Get "http://10.132.1.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

ProbeError

Startup probe error: Get "http://10.132.1.44:15021/healthz/ready": dial tcp 10.132.1.44:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

Unhealthy

Startup probe failed: Get "http://10.132.1.44:15021/healthz/ready": dial tcp 10.132.1.44:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a04e4e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a04e4e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a04e4e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a04e4e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-57dc6d-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-np274

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-57dc6d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-2msbd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

models-as-a-service

replicaset-controller

payload-processing-external-model-766b99cdcf

SuccessfulCreate

Created pod: payload-processing-external-model-766b99cdcf-m2gpm

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-766b99cdcf from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-766b99cdcf

FailedCreate

Error creating: pods "payload-processing-external-model-766b99cdcf-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-766b99cdcf-m2gpm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-766b99cdcf-m2gpm

Started

Container started

models-as-a-service

multus

payload-processing-external-model-766b99cdcf-m2gpm

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-766b99cdcf-m2gpm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-47c409-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-47c409-openshift-default-796cbb7889

SuccessfulCreate

Created pod: e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

openshift-ingress

deployment-controller

e2e-extmod-a-47c409-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-47c409-openshift-default-796cbb7889 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 2 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

Unhealthy

Startup probe failed: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

ProbeError

Startup probe error: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-766b99cdcf-m2gpm

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-m56vf

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-m56vf

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

AddedInterface

Add eth0 [10.132.1.89/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-m56vf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-m56vf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-m56vf

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-98755745d from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-98755745d-4s8cg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-98755745d-4s8cg

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-98755745d

SuccessfulCreate

Created pod: payload-processing-external-model-98755745d-4s8cg
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-98755745d

FailedCreate

Error creating: pods "payload-processing-external-model-98755745d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-98755745d-4s8cg

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-98755745d-4s8cg

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-98755745d-4s8cg

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-m56vf

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

Unhealthy

Startup probe failed: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

ProbeError

Startup probe error: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-m56vf

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

Unhealthy

Startup probe failed: Get "http://10.132.1.89:15021/healthz/ready": dial tcp 10.132.1.89:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

ProbeError

Startup probe error: Get "http://10.132.1.89:15021/healthz/ready": dial tcp 10.132.1.89:15021: connect: connection refused body:
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-98755745d

FailedCreate

Error creating: pods "payload-processing-external-model-98755745d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-98755745d from 0 to 1

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 6 to 10

models-as-a-service

kubelet

payload-processing-external-model-98755745d-wmjfq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

models-as-a-service

multus

payload-processing-external-model-98755745d-wmjfq

AddedInterface

Add eth0 [10.132.1.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

models-as-a-service

replicaset-controller

payload-processing-external-model-98755745d

SuccessfulCreate

Created pod: payload-processing-external-model-98755745d-wmjfq

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

models-as-a-service

kubelet

payload-processing-external-model-98755745d-wmjfq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-98755745d-wmjfq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

AddedInterface

Add eth0 [10.132.1.91/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

AddedInterface

Add eth0 [10.132.1.92/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

AddedInterface

Add eth0 [10.133.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-98755745d-wmjfq

Killing

Stopping container payload-processing
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-85f4bbf964

FailedCreate

Error creating: pods "payload-processing-external-model-85f4bbf964-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-85f4bbf964 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-85f4bbf964-9kp5p

Created

Container created
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

ProbeError

Startup probe error: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

ProbeError

Startup probe error: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-85f4bbf964

SuccessfulCreate

Created pod: payload-processing-external-model-85f4bbf964-9kp5p

models-as-a-service

kubelet

payload-processing-external-model-85f4bbf964-9kp5p

Started

Container started

models-as-a-service

multus

payload-processing-external-model-85f4bbf964-9kp5p

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

Unhealthy

Startup probe failed: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-85f4bbf964-9kp5p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

Unhealthy

Startup probe failed: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

ProbeError

Startup probe error: Get "http://10.132.1.92:15021/healthz/ready": dial tcp 10.132.1.92:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

Unhealthy

Startup probe failed: Get "http://10.132.1.92:15021/healthz/ready": dial tcp 10.132.1.92:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

ProbeError

Startup probe error: Get "http://10.132.1.91:15021/healthz/ready": dial tcp 10.132.1.91:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

Unhealthy

Startup probe failed: Get "http://10.132.1.91:15021/healthz/ready": dial tcp 10.132.1.91:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-85f4bbf964-9kp5p

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8973e2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-8973e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-8973e2-openshift-default-6bd79597f7 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-8973e2-openshift-default-6bd79597f7

SuccessfulCreate

Created pod: e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

openshift-ingress

multus

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

Unhealthy

Startup probe failed: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

ProbeError

Startup probe error: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused body:
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-57d6774b9c

FailedCreate

Error creating: pods "payload-processing-external-model-57d6774b9c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-57d6774b9c from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-57d6774b9c

SuccessfulCreate

Created pod: payload-processing-external-model-57d6774b9c-pzf46

models-as-a-service

kubelet

payload-processing-external-model-57d6774b9c-pzf46

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-57d6774b9c-pzf46

Created

Container created

models-as-a-service

multus

payload-processing-external-model-57d6774b9c-pzf46

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-57d6774b9c-pzf46

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

ProbeError

Readiness probe error: Get "http://10.134.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

Unhealthy

Readiness probe failed: Get "http://10.134.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

kubelet

payload-processing-external-model-57d6774b9c-pzf46

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7cf99f468c from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7cf99f468c

FailedCreate

Error creating: pods "payload-processing-external-model-7cf99f468c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-7cf99f468c-xjg96

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7cf99f468c-xjg96

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-7cf99f468c

SuccessfulCreate

Created pod: payload-processing-external-model-7cf99f468c-xjg96

models-as-a-service

kubelet

payload-processing-external-model-7cf99f468c-xjg96

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7cf99f468c-xjg96

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

Unhealthy

Readiness probe failed: Get "http://10.132.1.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

ProbeError

Readiness probe error: Get "http://10.132.1.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-7cf99f468c-xjg96

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-inf-a-670795-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-670795-openshift-default-764f54c759 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-670795

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-670795

openshift-ingress

replicaset-controller

e2e-inf-a-670795-openshift-default-764f54c759

SuccessfulCreate

Created pod: e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

openshift-ingress

multus

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

AddedInterface

Add eth0 [10.132.1.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-670795

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-670795-8c86c56f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-670795

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-670795-788dc77bff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-670795-788dc77bff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-670795-8c86c56f7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-670795-788dc77bff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-670795-788dc77bff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-670795: serviceaccount "payload-processing-e2e-inf-a-670795" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-670795-8c86c56f7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-670795-8c86c56f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-670795: serviceaccount "payload-processing-e2e-inf-a-670795" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs

Created

Container created

openshift-ingress

deployment-controller

e2e-inf-a-171edd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-171edd-openshift-default-78cdf84cf9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-171edd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-171edd

openshift-ingress

replicaset-controller

e2e-inf-a-171edd-openshift-default-78cdf84cf9

SuccessfulCreate

Created pod: e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

openshift-ingress

multus

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

AddedInterface

Add eth0 [10.132.1.109/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-171edd-78998dcc55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-171edd-78998dcc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-171edd: serviceaccount "payload-processing-e2e-inf-a-171edd" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-171edd-766c966749

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-171edd-766c966749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-171edd: serviceaccount "payload-processing-e2e-inf-a-171edd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-171edd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-171edd-766c966749 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-171edd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-171edd-78998dcc55 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-171edd-766c966749-c55nm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-171edd-766c966749

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-171edd-766c966749-c55nm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-171edd-78998dcc55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-171edd-766c966749-c55nm

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-171edd-766c966749-c55nm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-171edd-766c966749-c55nm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-670795-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-670795-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

openshift-ingress

deployment-controller

e2e-shared-b-w2-031745-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-031745-openshift-default-7f667bc645 from 3 to 2

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-lvnb4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-b9q2w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-965f61-openshift-default-55854964c from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-b2a372-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-7zpnc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-b2a372-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-b2a372-openshift-default-b75db95f7 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

ProbeError

Readiness probe error: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-tv22s

Unhealthy

Readiness probe failed: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-108ad8-openshift-default-5f6b668f95

SuccessfulCreate

Created pod: e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

openshift-ingress

gateway_labeler_controller

e2e-inf-a-108ad8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-108ad8

openshift-ingress

deployment-controller

e2e-inf-a-108ad8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-108ad8-openshift-default-5f6b668f95 from 0 to 1

openshift-ingress

multus

e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

AddedInterface

Add eth0 [10.132.1.116/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-108ad8-7495778969

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-108ad8-7495778969-49t8z
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-108ad8-7495778969

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-108ad8-7495778969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-108ad8: serviceaccount "payload-processing-e2e-inf-a-108ad8" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-108ad8: serviceaccount "payload-processing-e2e-inf-a-108ad8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-108ad8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-108ad8-7495778969 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-108ad8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-108ad8-7495778969-49t8z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-108ad8-7495778969-49t8z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-108ad8-7495778969-49t8z

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x

AddedInterface

Add eth0 [10.132.1.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-108ad8-7495778969-49t8z

AddedInterface

Add eth0 [10.132.1.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-a-04d111

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-04d111

openshift-ingress

deployment-controller

e2e-inf-a-04d111-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-04d111-openshift-default-cd549dc77 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-04d111-openshift-default-cd549dc77

SuccessfulCreate

Created pod: e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

openshift-ingress

multus

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-04d111-76d4bc867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-04d111-76d4bc867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-04d111: serviceaccount "payload-processing-e2e-inf-a-04d111" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-04d111-f77b9866c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-04d111-f77b9866c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-04d111: serviceaccount "payload-processing-e2e-inf-a-04d111" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-04d111

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-04d111-76d4bc867 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-04d111

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-04d111-f77b9866c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-04d111-76d4bc867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-04d111-f77b9866c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-04d111-f77b9866c-2mzsk

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04d111-f77b9866c-2mzsk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn

AddedInterface

Add eth0 [10.132.1.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04d111-f77b9866c-2mzsk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04d111-f77b9866c-2mzsk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-04d111-f77b9866c-2mzsk

AddedInterface

Add eth0 [10.132.1.120/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-a04e4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a04e4e-openshift-default-6fbf97c57 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57

SuccessfulCreate

Created pod: e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a04e4e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-b-829ac7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-829ac7-openshift-default-7f8ccddb6f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-829ac7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-829ac7

openshift-ingress

replicaset-controller

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f

SuccessfulCreate

Created pod: e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

openshift-ingress

multus

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

AddedInterface

Add eth0 [10.132.1.123/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

Unhealthy

Startup probe failed: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

ProbeError

Startup probe error: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-829ac7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-829ac7: serviceaccount "payload-processing-e2e-inf-b-829ac7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-829ac7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-829ac7-657c795bc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-829ac7-657c795bc9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-829ac7-657c795bc9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-829ac7-657c795bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-829ac7: serviceaccount "payload-processing-e2e-inf-b-829ac7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2

openshift-ingress

multus

payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2

AddedInterface

Add eth0 [10.132.1.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

Unhealthy

Readiness probe failed: Get "http://10.132.1.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

ProbeError

Readiness probe error: Get "http://10.132.1.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-a-1daf30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1daf30-openshift-default-58c8c5d5df from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-1daf30-openshift-default-58c8c5d5df

SuccessfulCreate

Created pod: e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1daf30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1daf30

openshift-ingress

multus

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

AddedInterface

Add eth0 [10.132.1.125/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

Unhealthy

Startup probe failed: Get "http://10.132.1.108:15021/healthz/ready": dial tcp 10.132.1.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

ProbeError

Startup probe error: Get "http://10.132.1.108:15021/healthz/ready": dial tcp 10.132.1.108:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1daf30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1daf30-654cd76bb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1daf30-654cd76bb7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1daf30-f769b9875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1daf30-f769b9875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1daf30-f769b9875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1daf30: serviceaccount "payload-processing-e2e-inf-a-1daf30" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1daf30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1daf30-f769b9875 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1daf30-654cd76bb7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1daf30-654cd76bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1daf30: serviceaccount "payload-processing-e2e-inf-a-1daf30" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fb346b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fb346b

openshift-ingress

deployment-controller

e2e-inf-b-fb346b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fb346b-openshift-default-744c56d4f9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-fb346b-openshift-default-744c56d4f9

SuccessfulCreate

Created pod: e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

openshift-ingress

multus

e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-670795-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-670795-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

ProbeError

Readiness probe error: Get "http://10.132.1.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

Unhealthy

Readiness probe failed: Get "http://10.132.1.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fb346b: serviceaccount "payload-processing-e2e-inf-b-fb346b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fb346b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fb346b-7f79f66479 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fb346b-5fbbccc457

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fb346b-5fbbccc457-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fb346b: serviceaccount "payload-processing-e2e-inf-b-fb346b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fb346b-5fbbccc457

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fb346b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fb346b-5fbbccc457 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

Unhealthy

Startup probe failed: Get "http://10.132.1.109:15021/healthz/ready": dial tcp 10.132.1.109:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

ProbeError

Startup probe error: Get "http://10.132.1.109:15021/healthz/ready": dial tcp 10.132.1.109:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-171edd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-171edd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

Unhealthy

Startup probe failed: Get "http://10.132.1.116:15021/healthz/ready": dial tcp 10.132.1.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

ProbeError

Startup probe error: Get "http://10.132.1.116:15021/healthz/ready": dial tcp 10.132.1.116:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-171edd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-171edd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-108ad8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-108ad8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

Unhealthy

Readiness probe failed: Get "http://10.132.1.123:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

ProbeError

Readiness probe error: Get "http://10.132.1.123:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

Unhealthy

Readiness probe failed: Get "http://10.133.0.215:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

ProbeError

Readiness probe error: Get "http://10.133.0.215:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-47e9af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-47e9af

openshift-ingress

replicaset-controller

e2e-inf-b-47e9af-openshift-default-5b7fdd8749

SuccessfulCreate

Created pod: e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

openshift-ingress

deployment-controller

e2e-inf-b-47e9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-47e9af-openshift-default-5b7fdd8749 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

Started

Container started

openshift-ingress

multus

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

AddedInterface

Add eth0 [10.132.1.126/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-47e9af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-47e9af-7cb88c595f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-47e9af-7cb88c595f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-47e9af-7cb88c595f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-47e9af: serviceaccount "payload-processing-e2e-inf-b-47e9af" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-47e9af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

ProbeError

Startup probe error: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-47e9af-7cb88c595f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-47e9af-7cb88c595f-s7jrb
(x6)

openshift-ingress

kubelet

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

Unhealthy

Startup probe failed: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-47e9af: serviceaccount "payload-processing-e2e-inf-b-47e9af" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-47e9af-7cb88c595f-s7jrb

AddedInterface

Add eth0 [10.132.1.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-47e9af-7cb88c595f-s7jrb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-47e9af-7cb88c595f-s7jrb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-47e9af-7cb88c595f-s7jrb

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-04d111-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-04d111-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-108ad8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-108ad8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

Unhealthy

Startup probe failed: Get "http://10.132.1.123:15021/healthz/ready": dial tcp 10.132.1.123:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

ProbeError

Startup probe error: Get "http://10.132.1.123:15021/healthz/ready": dial tcp 10.132.1.123:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-c1fe26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c1fe26-openshift-default-88665c78c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c1fe26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c1fe26

openshift-ingress

replicaset-controller

e2e-inf-b-c1fe26-openshift-default-88665c78c

SuccessfulCreate

Created pod: e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

openshift-ingress

multus

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

AddedInterface

Add eth0 [10.132.1.128/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c1fe26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c1fe26-7c97f95bc7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c1fe26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c1fe26: serviceaccount "payload-processing-e2e-inf-b-c1fe26" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c1fe26: serviceaccount "payload-processing-e2e-inf-b-c1fe26" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-04d111-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-04d111-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

Unhealthy

Readiness probe failed: Get "http://10.132.1.125:15021/healthz/ready": read tcp 10.132.0.2:37710->10.132.1.125:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

ProbeError

Readiness probe error: Get "http://10.132.1.125:15021/healthz/ready": read tcp 10.132.0.2:37710->10.132.1.125:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

Unhealthy

Startup probe failed: Get "http://10.132.1.125:15021/healthz/ready": dial tcp 10.132.1.125:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

ProbeError

Startup probe error: Get "http://10.132.1.125:15021/healthz/ready": dial tcp 10.132.1.125:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-829ac7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-829ac7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-b-12c0bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-12c0bc

openshift-ingress

replicaset-controller

e2e-inf-b-12c0bc-openshift-default-84bddf978c

SuccessfulCreate

Created pod: e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

openshift-ingress

deployment-controller

e2e-inf-b-12c0bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-12c0bc-openshift-default-84bddf978c from 0 to 1

openshift-ingress

multus

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1daf30-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1daf30-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-12c0bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-12c0bc-6785c7bbf7 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

ProbeError

Startup probe error: Get "http://10.133.0.217:15021/healthz/ready": dial tcp 10.133.0.217:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-12c0bc: serviceaccount "payload-processing-e2e-inf-b-12c0bc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-12c0bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

Unhealthy

Startup probe failed: Get "http://10.133.0.217:15021/healthz/ready": dial tcp 10.133.0.217:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-12c0bc-6785c7bbf7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-12c0bc: serviceaccount "payload-processing-e2e-inf-b-12c0bc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-12c0bc-6785c7bbf7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-8928h

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-8928h

AddedInterface

Add eth0 [10.132.1.130/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-fb346b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-8928h

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-fb346b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-8928h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-8928h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-fb346b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-fb346b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

Unhealthy

Startup probe failed: Get "http://10.132.1.126:15021/healthz/ready": dial tcp 10.132.1.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

ProbeError

Startup probe error: Get "http://10.132.1.126:15021/healthz/ready": dial tcp 10.132.1.126:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-47e9af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-47e9af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-47e9af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-47e9af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 10 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-dlm7k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-qfbk4
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qfbk4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

ProbeError

Readiness probe error: Get "http://10.133.0.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

Unhealthy

Readiness probe failed: Get "http://10.133.0.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

ProbeError

Startup probe error: Get "http://10.132.1.128:15021/healthz/ready": dial tcp 10.132.1.128:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

Unhealthy

Startup probe failed: Get "http://10.132.1.128:15021/healthz/ready": dial tcp 10.132.1.128:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

ProbeError

Startup probe error: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

Unhealthy

Startup probe failed: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c1fe26-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c1fe26-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-12c0bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-12c0bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c1fe26-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c1fe26-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-12c0bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-12c0bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-xwqm7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 8 to 7

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 3 to 2

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-9q9wx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 7 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j7hwx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-439989-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-439989-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-439989-openshift-default-8448c6ff99 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-439989-openshift-default-8448c6ff99

SuccessfulDelete

Deleted pod: e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-g9wnm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a04e4e-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-a04e4e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-a04e4e-openshift-default-6fbf97c57 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57

SuccessfulDelete

Deleted pod: e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-99pz4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-47c409-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-47c409-openshift-default-796cbb7889 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-47c409-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-47c409-openshift-default-796cbb7889

SuccessfulDelete

Deleted pod: e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-bm9cf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-031745-openshift-default-7f667bc645

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-031745-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w2-031745-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-031745-openshift-default-7f667bc645 from 2 to 1
(x5)

openshift-ingress

replicaset-controller

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

openshift-ingress

replicaset-controller

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df

SuccessfulDelete

Deleted pod: e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 2 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c4006d-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-md28j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-567ca6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-567ca6-openshift-default-74bf9cd4df from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-567ca6-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulDelete

Deleted pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v
(x6)

openshift-ingress

deployment-controller

e2e-worker-w4-c4006d-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-c4006d-openshift-default-7c985cbf7f from 2 to 1

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-5547v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8973e2-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-8973e2-openshift-default-6bd79597f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

openshift-ingress

deployment-controller

e2e-shared-a-w1-77a153-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-77a153-openshift-default-7778f45d97 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-77a153-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-8973e2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-8973e2-openshift-default-6bd79597f7 from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-77a153-openshift-default-7778f45d97

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-77a153-openshift-default-7778f45d97-t2jqz

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-6b9mg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-pdlqd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-kc5qw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w0-965f61-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-965f61-openshift-default-55854964c from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-965f61-openshift-default-55854964c

SuccessfulDelete

Deleted pod: e2e-worker-w0-965f61-openshift-default-55854964c-x829c

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-x829c

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-965f61-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rzxt7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-670795-788dc77bff-j9zfj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-670795-8c86c56f7-d5jqs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-670795-openshift-default-764f54c759-gtm6t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-829ac7-657c795bc9-t6554

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-829ac7-77fc54d55f-4npw2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-a-171edd-766c966749-c55nm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-171edd-766c966749-c55nm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-171edd-78998dcc55-2v6bb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lj6bl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-829ac7-openshift-default-7f8ccddb6f-q48vr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 5 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-m56vf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-m56vf

openshift-ingress

multus

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-47e9af-openshift-default-5b7fdd8749

SuccessfulCreate

Created pod: e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

openshift-ingress

deployment-controller

e2e-inf-b-47e9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-47e9af-openshift-default-5b7fdd8749 from 1 to 2

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-47e9af-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-kdw2v

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 2 to 1

openshift-ingress

deployment-controller

e2e-inf-b-c1fe26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c1fe26-openshift-default-88665c78c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-c1fe26-openshift-default-88665c78c

SuccessfulCreate

Created pod: e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c1fe26-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

Started

Container started

openshift-ingress

multus

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

AddedInterface

Add eth0 [10.133.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

Unhealthy

Startup probe failed: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

ProbeError

Startup probe error: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

Unhealthy

Startup probe failed: Get "http://10.133.0.239:15021/healthz/ready": dial tcp 10.133.0.239:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

ProbeError

Startup probe error: Get "http://10.133.0.239:15021/healthz/ready": dial tcp 10.133.0.239:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04d111-f77b9866c-2mzsk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-171edd-openshift-default-78cdf84cf9-8rtzl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-7wbkm

openshift-ingress

kubelet

payload-processing-e2e-inf-a-108ad8-7495778969-49t8z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7wbkm

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-l4jlq
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 3 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-5znqb

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

AddedInterface

Add eth0 [10.132.1.170/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04d111-76d4bc867-jmfjn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-04d111-openshift-default-cd549dc77-f9kwz

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

ProbeError

Startup probe error: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

Unhealthy

Startup probe failed: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb346b-5fbbccc457-skfrw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb346b-7f79f66479-vn5cf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1daf30-654cd76bb7-29rqh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

ProbeError

Startup probe error: Get "http://10.132.1.170:15021/healthz/ready": dial tcp 10.132.1.170:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

Unhealthy

Startup probe failed: Get "http://10.132.1.170:15021/healthz/ready": dial tcp 10.132.1.170:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1daf30-f769b9875-5xzlj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

Unhealthy

Startup probe failed: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

ProbeError

Startup probe error: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-108ad8-8d8c4c667-rbd9x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 6 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rdnft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-rdnft

AddedInterface

Add eth0 [10.132.1.171/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rdnft

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rdnft

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

Created

Container created
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rdnft

Unhealthy

Startup probe failed: Get "http://10.132.1.171:15021/healthz/ready": dial tcp 10.132.1.171:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rdnft

ProbeError

Startup probe error: Get "http://10.132.1.171:15021/healthz/ready": dial tcp 10.132.1.171:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

Unhealthy

Startup probe failed: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

ProbeError

Startup probe error: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c1fe26-7c97f95bc7-knlhj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c1fe26-7c889f576c-mptbr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-1daf30-openshift-default-58c8c5d5df-hhfzl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12c0bc-6785c7bbf7-8928h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-fb346b-openshift-default-744c56d4f9-mhkhz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-108ad8-openshift-default-5f6b668f95-4m7k7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-47e9af-7cb88c595f-s7jrb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12c0bc-69fdd4b4ff-n6qfz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-87h24

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-c1fe26-openshift-default-88665c78c-frz7j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-47e9af-74ddc46b6c-dbghm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-12c0bc-openshift-default-84bddf978c-ghhlp

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Unhealthy

Readiness probe failed: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

ProbeError

Readiness probe error: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-wtjff

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-47e9af-openshift-default-5b7fdd8749-hb7v2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 9 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-67f7j

AddedInterface

Add eth0 [10.132.1.174/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-67f7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-67f7j

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-67f7j

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-67f7j

Unhealthy

Startup probe failed: Get "http://10.132.1.174:15021/healthz/ready": dial tcp 10.132.1.174:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-67f7j

ProbeError

Startup probe error: Get "http://10.132.1.174:15021/healthz/ready": dial tcp 10.132.1.174:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-51cc4ce6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-51cc4ce6

openshift-ingress

deployment-controller

e2e-mt-51cc4ce6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-51cc4ce6-openshift-default-9f7d7c9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c

SuccessfulCreate

Created pod: e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

openshift-ingress

multus

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

AddedInterface

Add eth0 [10.132.1.175/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-x76x7

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-51cc4ce6-68c544d767

SuccessfulCreate

Created pod: payload-processing-e2e-mt-51cc4ce6-68c544d767-fgsbv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-51cc4ce6-68c544d767

FailedCreate

Error creating: pods "payload-processing-e2e-mt-51cc4ce6-68c544d767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-51cc4ce6: serviceaccount "payload-processing-e2e-mt-51cc4ce6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-51cc4ce6: serviceaccount "payload-processing-e2e-mt-51cc4ce6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-51cc4ce6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-51cc4ce6-68c544d767 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-51cc4ce6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-x76x7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-51cc4ce6-68c544d767-fgsbv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-51cc4ce6-68c544d767-fgsbv

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-51cc4ce6-68c544d767-fgsbv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-51cc4ce6-68c544d767-fgsbv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-x76x7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-x76x7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-x76x7

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

ProbeError

Readiness probe error: Get "http://10.132.1.175:15021/healthz/ready": read tcp 10.132.0.2:42806->10.132.1.175:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

Unhealthy

Readiness probe failed: Get "http://10.132.1.175:15021/healthz/ready": read tcp 10.132.0.2:42806->10.132.1.175:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

Unhealthy

Startup probe failed: Get "http://10.132.1.175:15021/healthz/ready": dial tcp 10.132.1.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

ProbeError

Startup probe error: Get "http://10.132.1.175:15021/healthz/ready": dial tcp 10.132.1.175:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-51cc4ce6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-51cc4ce6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-51cc4ce6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-51cc4ce6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-47c409-d86754547-hbqjk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-47c409-8649bf6df7-rbdch

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-401761-f8dbb88dc-9ks76

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-401761-6ddf8dc4bf-fbwrw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-47c409-openshift-default-796cbb7889-drd46

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-401761-openshift-default-6cdf858b5-7z2jc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-567ca6-openshift-default-74bf9cd4df-dj9fv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-mt-51cc4ce6-68c544d767-fgsbv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51cc4ce6-cb9cdcf4c-x76x7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a04e4e-7f98ff8fc5-ltn95

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a04e4e-566bc9db7f-htzll

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-567ca6-86cc9d6977-pk7jd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-567ca6-7fdf68b675-mfgzr

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.1.25:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c9707f-8598fffd47-fcvbn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c9707f-5d5859459c-tv5n9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-a04e4e-openshift-default-6fbf97c57-srtdz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-c9707f-openshift-default-65b9677b4c-b57kk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-51cc4ce6-openshift-default-9f7d7c9c-7v7ml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-77a153-openshift-default-7778f45d97-pzlhr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-031745-6d7b5f78dc-6k5z9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-031745-74cd69fbc5-s7bs2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-77a153-6d7d74f579-mfw72

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-77a153-6c975c99f5-mp8vx

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.241:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-shared-b-w1-d6ac82-openshift-default-56596855f-5chnq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d6ac82-75d47769c-bb76f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d6ac82-8687db9c8c-c4fl6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-031745-openshift-default-7f667bc645-nf7gq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c

SuccessfulCreate

Created pod: e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-a-w3-338f2e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-338f2e-openshift-default-67bb4686c from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-338f2e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

Started

Container started
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-439989-6b4f868455-v228h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-439989-5d779f9865-lc48d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-09a20a-5bf985cbc9-scqzr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-09a20a-b4f7d6d49-2lp58

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-439989-openshift-default-8448c6ff99-q7m9r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w2-09a20a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-09a20a-openshift-default-55d8647ff from 1 to 4

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-09a20a-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

openshift-ingress

replicaset-controller

e2e-worker-w2-09a20a-openshift-default-55d8647ff

SuccessfulCreate

Created pod: e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

Started

Container started

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

AddedInterface

Add eth0 [10.132.1.188/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

AddedInterface

Add eth0 [10.132.1.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-654741-5dbd945cf9-wrd4x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-654741-785568f87c-8k8tt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-654741-openshift-default-8449896d9c-cf4pt

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

Unhealthy

Startup probe failed: Get "http://10.132.1.188:15021/healthz/ready": dial tcp 10.132.1.188:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

ProbeError

Startup probe error: Get "http://10.132.1.188:15021/healthz/ready": dial tcp 10.132.1.188:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

Unhealthy

Startup probe failed: Get "http://10.132.1.189:15021/healthz/ready": dial tcp 10.132.1.189:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

ProbeError

Startup probe error: Get "http://10.132.1.189:15021/healthz/ready": dial tcp 10.132.1.189:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-scmn8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-sll2c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-czlrj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-09a20a-openshift-default-55d8647ff-qjghh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ded435-5cbbf45d4c-j9btt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ded435-5787fc7f9-c9dqc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-ded435-openshift-default-6c5655ff69-qb5zt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-57dc6d-66998bfb9f-tdltw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-57dc6d-openshift-default-6c5bd8885c-dfg6z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-57dc6d-5675c77f6c-8t8zt

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.149:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc

Killing

Stopping container payload-pre-processing

opendatahub

multus

test-curl-7096-c7f796

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7096-c7f796

Started

Container started

opendatahub

kubelet

test-curl-7096-c7f796

Created

Container created

opendatahub

kubelet

test-curl-7096-c7f796

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pghv7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-rdnft

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 10 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rdnft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-67f7j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-pr6rq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-pr6rq
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

opendatahub

multus

test-curl-7096-024b07

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7096-024b07

Started

Container started

opendatahub

kubelet

test-curl-7096-024b07

Created

Container created

opendatahub

kubelet

test-curl-7096-024b07

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7096-c7f796

Killing

Stopping container test-curl-7096-c7f796

opendatahub

kubelet

test-curl-7096-024b07

Killing

Stopping container test-curl-7096-024b07
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9633f0-54d5b879f5-qg5lc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9633f0-6b8776566f-bbqd7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w4-9633f0-openshift-default-84b674487f-dkkf6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-afc519-d746ff6cc-npmp9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-afc519-69cbc98467-l7w68

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c4006d-7bd575dbdf-h26mj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c4006d-548d7c6f4c-nj2nr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-afc519-openshift-default-dfdbf9b97-qvdkl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-8973e2-openshift-default-6bd79597f7-h2ldn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-c4006d-openshift-default-7c985cbf7f-brpvl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-a99f2a-openshift-default-77649d68d5-cmchk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8973e2-849bd8687-5kxc2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8973e2-85c9f98f95-rgkrh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-227c93-openshift-default-74bc588c4f-sqhs4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-227c93-74b5c495fc-v4rxp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-227c93-5c594ccb75-k8gp2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a99f2a-5bb987db5-2m54d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a99f2a-74bfdc65dc-9j694

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-dvgp9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-338f2e-openshift-default-67bb4686c-b4n6p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-766728-openshift-default-647554f999-xfztz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-338f2e-6ccbc66d75-htxcd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-338f2e-57f7757bf-mchhm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-766728-d66dffc49-llqqr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-766728-69794bbd5f-s8zfz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-b2a372-openshift-default-b75db95f7-5n2gs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-25f56e-openshift-default-6465df847-6j725

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b2a372-84cc9765b7-8q729

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b2a372-dfc6bb5c9-2t4p7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-25f56e-69577647c5-wvb9t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-25f56e-bd47bbbd9-r4fhf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4c2387-78fdcfbd75-2twf4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4c2387-78c59569f5-pklf6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4c2387-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-4c2387-openshift-default-5b68d44445

SuccessfulCreate

Created pod: e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-4c2387-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4c2387-openshift-default-5b68d44445 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h

AddedInterface

Add eth0 [10.132.1.211/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-965f61-84cf84d479-gq7q5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-965f61-576d68cfbf-ffkvw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h

Unhealthy

Startup probe failed: Get "http://10.132.1.211:15021/healthz/ready": dial tcp 10.132.1.211:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h

ProbeError

Startup probe error: Get "http://10.132.1.211:15021/healthz/ready": dial tcp 10.132.1.211:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-h4p8h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4c2387-openshift-default-5b68d44445-d7frf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-965f61-openshift-default-55854964c-gr6vr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ait-8d386766-openshift-default-575667689c

SuccessfulCreate

Created pod: e2e-ait-8d386766-openshift-default-575667689c-n858k

openshift-ingress

deployment-controller

e2e-ait-8d386766-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8d386766-openshift-default-575667689c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8d386766

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8d386766

openshift-ingress

multus

e2e-ait-8d386766-openshift-default-575667689c-n858k

AddedInterface

Add eth0 [10.132.1.212/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8d386766

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8d386766-564db46ccf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8d386766

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8d386766-9d98995bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-8d386766-564db46ccf-p7vc2

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8d386766-9d98995bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8d386766-9d98995bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8d386766: serviceaccount "payload-processing-e2e-ait-8d386766" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-8d386766-9d98995bc-8srn5

AddedInterface

Add eth0 [10.132.1.214/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8d386766-564db46ccf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8d386766-564db46ccf-p7vc2

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d386766-9d98995bc-8srn5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d386766-9d98995bc-8srn5

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8d386766-564db46ccf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8d386766-564db46ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8d386766: serviceaccount "payload-processing-e2e-ait-8d386766" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d386766-9d98995bc-8srn5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-8d386766-564db46ccf-p7vc2

AddedInterface

Add eth0 [10.132.1.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8d386766-564db46ccf-p7vc2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8d386766-9d98995bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8d386766-9d98995bc-8srn5

openshift-ingress

kubelet

payload-processing-e2e-ait-8d386766-564db46ccf-p7vc2

Created

Container created

openshift-ingress

kubelet

e2e-ait-8d386766-openshift-default-575667689c-n858k

ProbeError

Readiness probe error: Get "http://10.132.1.212:15021/healthz/ready": dial tcp 10.132.1.212:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-8d386766-openshift-default-575667689c-n858k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-8d386766-openshift-default-575667689c-n858k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-8d386766-openshift-default-575667689c-n858k

Created

Container created

openshift-ingress

kubelet

e2e-ait-8d386766-openshift-default-575667689c-n858k

Unhealthy

Readiness probe failed: Get "http://10.132.1.212:15021/healthz/ready": dial tcp 10.132.1.212:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-8d386766-openshift-default-575667689c-n858k

Unhealthy

Startup probe failed: Get "http://10.132.1.212:15021/healthz/ready": dial tcp 10.132.1.212:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-8d386766-openshift-default-575667689c-n858k

ProbeError

Startup probe error: Get "http://10.132.1.212:15021/healthz/ready": dial tcp 10.132.1.212:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d386766-9d98995bc-8srn5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8d386766-564db46ccf-p7vc2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-8d386766-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-8d386766-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-8d386766-openshift-default-575667689c-n858k

Killing

Stopping container istio-proxy

opendatahub

kubelet

maas-controller-85c4f7957c-mh7qn

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-85c4f7957c

SuccessfulDelete

Deleted pod: maas-controller-85c4f7957c-mh7qn

opendatahub

replicaset-controller

maas-controller-85c4f7957c

SuccessfulCreate

Created pod: maas-controller-85c4f7957c-rzwcg

opendatahub

multus

maas-controller-85c4f7957c-rzwcg

AddedInterface

Add eth0 [10.132.1.216/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-85c4f7957c-rzwcg

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:2a8af487b02cdd2697131845886ed681d44962affee63d93743ff642af9d7a27"

opendatahub

kubelet

maas-controller-85c4f7957c-rzwcg

Created

Container created

opendatahub

kubelet

maas-controller-85c4f7957c-rzwcg

Started

Container started

opendatahub

kubelet

maas-controller-85c4f7957c-rzwcg

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:2a8af487b02cdd2697131845886ed681d44962affee63d93743ff642af9d7a27" in 1.593s (1.593s including waiting). Image size: 200094741 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 6 to 5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-n5dnl

Killing

Stopping container istio-proxy

opendatahub

maas-controller-85c4f7957c-rzwcg_2a0ccdd1-e8bd-4c95-9b10-452ec1fdfcc0

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-85c4f7957c-rzwcg_2a0ccdd1-e8bd-4c95-9b10-452ec1fdfcc0 became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 5 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

AddedInterface

Add eth0 [10.132.1.221/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

AddedInterface

Add eth0 [10.132.1.218/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

AddedInterface

Add eth0 [10.132.1.220/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-shld4

AddedInterface

Add eth0 [10.132.1.219/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

AddedInterface

Add eth0 [10.133.0.244/23] from ovn-kubernetes
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-85c4f7957c from 1 to 0

opendatahub

replicaset-controller

maas-controller-85c4f7957c

SuccessfulDelete

Deleted pod: maas-controller-85c4f7957c-rzwcg

opendatahub

kubelet

maas-controller-85c4f7957c-rzwcg

Killing

Stopping container manager
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

ProbeError

Startup probe error: Get "http://10.133.0.244:15021/healthz/ready": dial tcp 10.133.0.244:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

Unhealthy

Startup probe failed: Get "http://10.133.0.244:15021/healthz/ready": dial tcp 10.133.0.244:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

ProbeError

Startup probe error: Get "http://10.132.1.219:15021/healthz/ready": dial tcp 10.132.1.219:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

ProbeError

Startup probe error: Get "http://10.132.1.220:15021/healthz/ready": dial tcp 10.132.1.220:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

Unhealthy

Startup probe failed: Get "http://10.132.1.219:15021/healthz/ready": dial tcp 10.132.1.219:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

ProbeError

Startup probe error: Get "http://10.132.1.218:15021/healthz/ready": dial tcp 10.132.1.218:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

ProbeError

Startup probe error: Get "http://10.132.1.221:15021/healthz/ready": dial tcp 10.132.1.221:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

Unhealthy

Startup probe failed: Get "http://10.132.1.221:15021/healthz/ready": dial tcp 10.132.1.221:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

Unhealthy

Startup probe failed: Get "http://10.132.1.220:15021/healthz/ready": dial tcp 10.132.1.220:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

Unhealthy

Startup probe failed: Get "http://10.132.1.218:15021/healthz/ready": dial tcp 10.132.1.218:15021: connect: connection refused

opendatahub

replicaset-controller

maas-controller-85c4f7957c

SuccessfulCreate

Created pod: maas-controller-85c4f7957c-jtbfr
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-85c4f7957c from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

ProbeError

Startup probe error: Get "http://10.132.1.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

Unhealthy

Startup probe failed: Get "http://10.132.1.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

ProbeError

Startup probe error: Get "http://10.132.1.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

maas-controller-85c4f7957c-jtbfr

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:2a8af487b02cdd2697131845886ed681d44962affee63d93743ff642af9d7a27"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

ProbeError

Startup probe error: Get "http://10.132.1.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

maas-controller-85c4f7957c-jtbfr

Started

Container started

opendatahub

kubelet

maas-controller-85c4f7957c-jtbfr

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:2a8af487b02cdd2697131845886ed681d44962affee63d93743ff642af9d7a27" in 339ms (339ms including waiting). Image size: 200094741 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

Unhealthy

Startup probe failed: Get "http://10.132.1.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

Unhealthy

Startup probe failed: Get "http://10.132.1.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

multus

maas-controller-85c4f7957c-jtbfr

AddedInterface

Add eth0 [10.133.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

ProbeError

Startup probe error: Get "http://10.132.1.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

maas-controller-85c4f7957c-jtbfr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

Unhealthy

Startup probe failed: Get "http://10.132.1.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

maas-controller-85c4f7957c-jtbfr_a1a610d6-df51-48e4-92e3-161e5f6856c4

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-85c4f7957c-jtbfr_a1a610d6-df51-48e4-92e3-161e5f6856c4 became leader

llm

deployment-controller

e2e-prio-pool-119c987e-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-119c987e-kserve-66959d954d from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.Deployment llm/e2e-prio-pool-119c987e-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.Service llm/e2e-prio-pool-119c987e-epp-service

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.Secret llm/e2e-prio-pool-119c987e-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.Service llm/e2e-prio-pool-119c987e-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.ServiceAccount llm/e2e-prio-pool-119c987e-epp-sa

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-119c987e-epp-auth-rb

llm

deployment-controller

e2e-prio-pool-119c987e-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.Deployment llm/e2e-prio-pool-119c987e-kserve-router-scheduler

llm

replicaset-controller

e2e-prio-pool-119c987e-kserve-66959d954d

SuccessfulCreate

Created pod: e2e-prio-pool-119c987e-kserve-66959d954d-kln77

llm

replicaset-controller

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7

SuccessfulCreate

Created pod: e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.RoleBinding llm/e2e-prio-pool-119c987e-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

Created v1.Role llm/e2e-prio-pool-119c987e-epp-role

llm

multus

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

AddedInterface

Add eth0 [10.133.0.246/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-119c987e-kserve-66959d954d-kln77

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-prio-pool-119c987e-kserve-66959d954d-kln77

Created

Container created

llm

kubelet

e2e-prio-pool-119c987e-kserve-66959d954d-kln77

Started

Container started

llm

multus

e2e-prio-pool-119c987e-kserve-66959d954d-kln77

AddedInterface

Add eth0 [10.132.1.226/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-119c987e-kserve-route
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-119c987e-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

Started

Container started

llm

kubelet

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

Created

Container created

llm

kubelet

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 1.621s (1.621s including waiting). Image size: 184206420 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Updated

Updated v1.Secret llm/e2e-prio-pool-119c987e-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-119c987e] is Ready

llm

LLMInferenceServiceController

e2e-prio-pool-119c987e

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-119c987e-epp-auth-rb

llm

kubelet

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-119c987e-kserve-66959d954d-kln77

Killing

Stopping container main

openshift-ingress

deployment-controller

e2e-worker-single-main-5534f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-5534f0-openshift-default-58cd9846b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5

SuccessfulCreate

Created pod: e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-5534f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-5534f0

openshift-ingress

multus

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

AddedInterface

Add eth0 [10.132.1.229/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-5534f0-869ff6db45

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-5534f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7bb7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-5534f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-5534f0-869ff6db45 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-5534f0: serviceaccount "payload-processing-e2e-worker-single-main-5534f0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-5534f0-869ff6db45

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-5534f0-869ff6db45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-5534f0: serviceaccount "payload-processing-e2e-worker-single-main-5534f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4

AddedInterface

Add eth0 [10.132.1.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs

AddedInterface

Add eth0 [10.132.1.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

ProbeError

Readiness probe error: Get "http://10.132.1.229:15021/healthz/ready": read tcp 10.132.0.2:50032->10.132.1.229:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

Unhealthy

Readiness probe failed: Get "http://10.132.1.229:15021/healthz/ready": read tcp 10.132.0.2:50032->10.132.1.229:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

ProbeError

Startup probe error: Get "http://10.132.1.229:15021/healthz/ready": dial tcp 10.132.1.229:15021: connect: connection refused body:
(x5)

llm

kubelet

e2e-prio-pool-119c987e-kserve-router-scheduler-64ddb68fd7-gp6lm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

Unhealthy

Startup probe failed: Get "http://10.132.1.229:15021/healthz/ready": dial tcp 10.132.1.229:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-5534f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-5534f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-5534f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-5534f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db452mp4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7ltrbs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-5534f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-5534f0-869ff6db45 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7q4drj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-5534f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7bb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7q4drj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-5534f0-869ff6db45

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-5534f0-869ff6db45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-5534f0: serviceaccount "payload-processing-e2e-worker-single-main-5534f0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-5534f0-869ff6db45

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-5534f0-869ff6db4pxdqx

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7q4drj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7q4drj

AddedInterface

Add eth0 [10.133.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7q4drj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db4pxdqx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db4pxdqx

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-5534f0: serviceaccount "payload-processing-e2e-worker-single-main-5534f0" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db4pxdqx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-5534f0-869ff6db4pxdqx

AddedInterface

Add eth0 [10.132.1.234/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5534f0-869ff6db4pxdqx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5534f0-cfbf7q4drj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-5534f0-openshift-default-58cd9846b5h745k

Killing

Stopping container istio-proxy

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Created

Created v1.Secret llm/e2e-same-id-a-784e0608-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Created

Created v1.Service llm/e2e-same-id-a-784e0608-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Created

Created v1.PodMonitor llm/e2e-same-id-a-784e0608-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Created

Created v1.PodMonitor llm/e2e-same-id-a-784e0608-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Created

Created v1.DestinationRule llm/e2e-same-id-a-784e0608-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Created

Created v1.HTTPRoute llm/e2e-same-id-a-784e0608-kserve-route

llm

replicaset-controller

e2e-same-id-a-784e0608-kserve-7cdf47df77

SuccessfulCreate

Created pod: e2e-same-id-a-784e0608-kserve-7cdf47df77-sn6vk

llm

deployment-controller

e2e-same-id-a-784e0608-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-784e0608-kserve-7cdf47df77 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Created

Created v1.Deployment llm/e2e-same-id-a-784e0608-kserve

llm

multus

e2e-same-id-a-784e0608-kserve-7cdf47df77-sn6vk

AddedInterface

Add eth0 [10.132.1.235/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-a-784e0608-kserve-7cdf47df77-sn6vk

Created

Container created

llm

kubelet

e2e-same-id-a-784e0608-kserve-7cdf47df77-sn6vk

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-a-784e0608-kserve-7cdf47df77-sn6vk

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-784e0608-prometheus-scraping
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

Updated

Updated v1.Secret llm/e2e-same-id-a-784e0608-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-784e0608] is Ready

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Created

Created v1.PodMonitor llm/e2e-same-id-b-784e0608-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Created

Created v1.PodMonitor llm/e2e-same-id-b-784e0608-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Created

Created v1.DestinationRule llm/e2e-same-id-b-784e0608-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Created

Created v1.HTTPRoute llm/e2e-same-id-b-784e0608-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Created

Created v1.Service llm/e2e-same-id-b-784e0608-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Created

Created v1.Deployment llm/e2e-same-id-b-784e0608-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Created

Created v1.Secret llm/e2e-same-id-b-784e0608-kserve-self-signed-certs

llm

deployment-controller

e2e-same-id-b-784e0608-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-784e0608-kserve-6d98d66ff7 from 0 to 1

llm

replicaset-controller

e2e-same-id-b-784e0608-kserve-6d98d66ff7

SuccessfulCreate

Created pod: e2e-same-id-b-784e0608-kserve-6d98d66ff7-hz49g

llm

kubelet

e2e-same-id-b-784e0608-kserve-6d98d66ff7-hz49g

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-784e0608-prometheus-scraping

llm

multus

e2e-same-id-b-784e0608-kserve-6d98d66ff7-hz49g

AddedInterface

Add eth0 [10.132.1.236/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-784e0608-kserve-6d98d66ff7-hz49g

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-b-784e0608-kserve-6d98d66ff7-hz49g

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

Updated

Updated v1.Secret llm/e2e-same-id-b-784e0608-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-784e0608] is Ready
(x7)

llm

LLMInferenceServiceController

e2e-same-id-b-784e0608

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-784e0608 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-784e0608; safe to ignore if traffic splitting is planned
(x3)

llm

LLMInferenceServiceController

e2e-same-id-a-784e0608

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-784e0608 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-784e0608; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-784e0608-kserve-7cdf47df77-sn6vk

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-784e0608-kserve-6d98d66ff7-hz49g

Killing

Stopping container main

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6554894b6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-6554894b6b

SuccessfulCreate

Created pod: payload-pre-processing-6554894b6b-98v2m

openshift-ingress

kubelet

payload-pre-processing-6554894b6b-98v2m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-6554894b6b-98v2m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-6554894b6b-98v2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-6554894b6b-98v2m

AddedInterface

Add eth0 [10.132.1.240/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-n2mk7

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2mk7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-7d68ddf775-nv8tc

Created

Container created

openshift-ingress

multus

payload-processing-7d68ddf775-nv8tc

AddedInterface

Add eth0 [10.133.0.249/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-7d68ddf775-nv8tc

Started

Container started

openshift-ingress

kubelet

payload-processing-7d68ddf775-nv8tc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-7d68ddf775 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-7d68ddf775

SuccessfulCreate

Created pod: payload-processing-7d68ddf775-nv8tc

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-cpb5g

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-cpb5g

openshift-ingress

replicaset-controller

payload-pre-processing-5bd7d6d88

SuccessfulCreate

Created pod: payload-pre-processing-5bd7d6d88-dth2t

openshift-ingress

replicaset-controller

payload-processing-6ddb9b8755

SuccessfulCreate

Created pod: payload-processing-6ddb9b8755-bwn8k

openshift-ingress

multus

payload-processing-6ddb9b8755-bwn8k

AddedInterface

Add eth0 [10.133.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-6ddb9b8755-bwn8k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-5bd7d6d88 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-6ddb9b8755 from 0 to 1

openshift-ingress

kubelet

payload-processing-6ddb9b8755-bwn8k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-5bd7d6d88-dth2t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-5bd7d6d88-dth2t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-5bd7d6d88-dth2t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-5bd7d6d88-dth2t

AddedInterface

Add eth0 [10.132.1.241/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-6ddb9b8755-bwn8k

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-6554894b6b

SuccessfulDelete

Deleted pod: payload-pre-processing-6554894b6b-98v2m

openshift-ingress

kubelet

payload-pre-processing-6554894b6b-98v2m

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-6554894b6b from 1 to 0

openshift-ingress

kubelet

payload-processing-7d68ddf775-nv8tc

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-7d68ddf775 from 1 to 0

openshift-ingress

replicaset-controller

payload-processing-7d68ddf775

SuccessfulDelete

Deleted pod: payload-processing-7d68ddf775-nv8tc

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-zdvn7

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-zdvn7

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5bcd7997-zdvn7

AddedInterface

Add eth0 [10.133.0.251/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-zdvn7

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-zdvn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-zdvn7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

ProbeError

Readiness probe error: Get "http://10.133.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-ptb2g

Unhealthy

Readiness probe failed: Get "http://10.133.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-9632aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-9632aa

openshift-ingress

deployment-controller

e2e-worker-single-main-9632aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bf

SuccessfulCreate

Created pod: e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

openshift-ingress

multus

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

AddedInterface

Add eth0 [10.133.0.252/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-9632aa-55bd85fbdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-9632aa-55bd85fbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-9632aa: serviceaccount "payload-processing-e2e-worker-single-main-9632aa" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-9632aa-687df6dccf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-9632aa-687df6dccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-9632aa: serviceaccount "payload-processing-e2e-worker-single-main-9632aa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-9632aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-9632aa-55bd85fbdc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-9632aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-9632aa-687df6dccf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-9632aa-687df6dccf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-9632aa-55bd85fbdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd

openshift-ingress

multus

payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

Unhealthy

Readiness probe failed: Get "http://10.133.0.252:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

ProbeError

Readiness probe error: Get "http://10.133.0.252:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

ProbeError

Startup probe error: Get "http://10.133.0.252:15021/healthz/ready": dial tcp 10.133.0.252:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

Unhealthy

Startup probe failed: Get "http://10.133.0.252:15021/healthz/ready": dial tcp 10.133.0.252:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-9632aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-9632aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-9632aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-9632aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccdb2v2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8dg9nd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-9632aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-9632aa-55bd85fbdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-9632aa-55bd85fbdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-9632aa-55bd8w5ksw

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-9632aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-9632aa-687df6dccf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-9632aa-55bd85fbdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-9632aa-55bd85fbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-9632aa: serviceaccount "payload-processing-e2e-worker-single-main-9632aa" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-9632aa-687df6dccf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-9632aa-687df6dccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-9632aa: serviceaccount "payload-processing-e2e-worker-single-main-9632aa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-9632aa-687df6dccf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-9632aa-687df6dccwv6lt

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccwv6lt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccwv6lt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-single-main-9632aa-687df6dccwv6lt

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8w5ksw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8w5ksw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8w5ksw

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccwv6lt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8w5ksw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-9632aa-687df6dccwv6lt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-9632aa-55bd8w5ksw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-9632aa-openshift-default-6b55b9f5bfbtp9d

Killing

Stopping container istio-proxy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-vwcwp

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-vwcwp

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-cljqx
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-cljqx

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-cljqx

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-cljqx

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-cljqx

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-cljqx_c942f73d-6837-47c7-963e-de9e310e1598

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-cljqx_c942f73d-6837-47c7-963e-de9e310e1598 became leader
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

Unhealthy

Readiness probe failed: Get "http://10.132.1.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

Unhealthy

Readiness probe failed: Get "http://10.132.1.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

Unhealthy

Readiness probe failed: Get "http://10.132.1.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

Unhealthy

Readiness probe failed: Get "http://10.133.0.211:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nv4mk

ProbeError

Readiness probe error: Get "http://10.133.0.211:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wzfdx

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

ProbeError

Readiness probe error: Get "http://10.132.1.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rgj85

ProbeError

Readiness probe error: Get "http://10.132.1.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-shld4

ProbeError

Readiness probe error: Get "http://10.132.1.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lqrr5

ProbeError

Readiness probe error: Get "http://10.132.1.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hgv9r

Unhealthy

Readiness probe failed: Get "http://10.132.1.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

ProbeError

Readiness probe error: Get "http://10.134.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-5znqb

Unhealthy

Readiness probe failed: Get "http://10.134.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

ProbeError

Readiness probe error: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-jd8wd

Unhealthy

Readiness probe failed: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

ProbeError

Readiness probe error: Get "http://10.133.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-l4jlq

Unhealthy

Readiness probe failed: Get "http://10.133.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)