Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-59vp8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-59vp8 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb to ip-10-0-143-206.us-east-2.compute.internal

ai-tenants

e2e-api-a-b34f6c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-b34f6c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-c5b820

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-c5b820: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-cc7720

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-cc7720: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-29f633

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-29f633: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-9a6d4b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-9a6d4b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-ad865c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-ad865c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-b0f9d6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-b0f9d6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-f20fc0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-f20fc0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-36556d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-36556d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-78d47a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-78d47a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-33e267

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-33e267: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-8b7351

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-8b7351: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-98529d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-98529d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-a0d4ec

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-a0d4ec: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-eb69cb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-eb69cb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-0e1546

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-0e1546: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-0e4ce7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-0e4ce7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-46a6d7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-46a6d7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-4c2a28

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-4c2a28: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-b503a8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-b503a8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-d2aa3b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-d2aa3b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-e7b70d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-e7b70d: MaasTenantConfig is terminating and cannot restore revocation operands

ai-tenants

e2e-inf-b-74dfc6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-74dfc6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-389e6d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-389e6d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-3b6e2b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-3b6e2b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-6cd7f4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-6cd7f4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-c6092e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-c6092e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-277dc9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-277dc9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-3d1db1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-3d1db1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-8b3020

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-8b3020: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-9b3619

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-9b3619: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-d8d238bf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-d8d238bf: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-1b1d04

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-1b1d04: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-3faa07

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-3faa07: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-8fa615

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-8fa615: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-5cf30a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-5cf30a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-c131fa

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-c131fa: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-f493f7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-f493f7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-4fb1d0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-4fb1d0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-f154ac

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-f154ac: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-836265

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-836265: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-bfc240

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-bfc240: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-942930

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-942930: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-81a5ae

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-81a5ae: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-43c674

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-43c674: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-660d95

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-660d95: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-bcfde8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-bcfde8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-88a18e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-88a18e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-d3d0df

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-d3d0df: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-32e482

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-32e482: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-9f46e5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-9f46e5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-3fbb1a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-3fbb1a: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-c8rm9

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-c8rm9 to ip-10-0-133-249.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8464c976fd-cpxbn to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

Preempted

Preempted by pod f76f8240-ab05-410c-8a60-1d7b8cdde912 on node ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-0a2237-867f7ff655-k2kck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-0a2237-867f7ff655-k2kck to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-rdxgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-rdxgr to ip-10-0-143-206.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-k47sq

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-k47sq to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-trbdq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-trbdq to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-v5hs6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-v5hs6 to ip-10-0-143-206.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8464c976fd-9b8p5 to ip-10-0-132-83.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8464c976fd-8g6hn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-cc7720-7464f494bc-rjzsz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-cc7720-7464f494bc-rjzsz to ip-10-0-143-206.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-dgdfv

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-dgdfv

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-564sz

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-564sz to ip-10-0-133-249.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-59rwc

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-59rwc to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-29f633-6f8fb58955-x6jlg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-29f633-6f8fb58955-x6jlg to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-lls72

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-lls72 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-nbncx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-nbncx to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-qh7ds

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-qh7ds to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f20fc0-89489b479-5h6bb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f20fc0-89489b479-5h6bb to ip-10-0-143-206.us-east-2.compute.internal

opendatahub

test-curl-7243-900536

Scheduled

Successfully assigned opendatahub/test-curl-7243-900536 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-36556d-58f7c56d79-psw9k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-36556d-58f7c56d79-psw9k to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-8c14f244-656fd8c655-c4l2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8c14f244-656fd8c655-c4l2m to ip-10-0-132-83.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-dgdfv

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8464c976fd-dgdfv to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-c20ed791-649568bc75-gnp7d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c20ed791-649568bc75-gnp7d to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s to ip-10-0-143-206.us-east-2.compute.internal

opendatahub

test-curl-7243-3ef9d3

Scheduled

Successfully assigned opendatahub/test-curl-7243-3ef9d3 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n to ip-10-0-143-206.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-x5lg7

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-x5lg7 to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

test-curl-7243-385b32

Scheduled

Successfully assigned opendatahub/test-curl-7243-385b32 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-78d47a-66f8c9595-xvsjj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-78d47a-66f8c9595-xvsjj to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-lsm58

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-lsm58 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f to ip-10-0-132-83.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-cshnh

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-cshnh to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-dxgp7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-dxgp7 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd to ip-10-0-132-83.us-east-2.compute.internal

kuadrant-system

authorino-66b59d468d-5bfd2

Scheduled

Successfully assigned kuadrant-system/authorino-66b59d468d-5bfd2 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

authorino-66b59d468d-j8ndl

Scheduled

Successfully assigned kuadrant-system/authorino-66b59d468d-j8ndl to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255 to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

test-curl-7240-e41344

Scheduled

Successfully assigned opendatahub/test-curl-7240-e41344 to ip-10-0-143-206.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-nlh5d

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-nlh5d to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h to ip-10-0-133-249.us-east-2.compute.internal

kuadrant-system

authorino-6dd76875b5-sf54c

Scheduled

Successfully assigned kuadrant-system/authorino-6dd76875b5-sf54c to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh to ip-10-0-143-206.us-east-2.compute.internal

kuadrant-system

authorino-77f7f55747-slnb6

Scheduled

Successfully assigned kuadrant-system/authorino-77f7f55747-slnb6 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz to ip-10-0-132-83.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-nj52h

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-nj52h to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44 to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

test-curl-7240-ae2e10

Scheduled

Successfully assigned opendatahub/test-curl-7240-ae2e10 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl to ip-10-0-132-83.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-v5xhc

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

kuadrant-system

authorino-operator-7b7bb4bc77-v5xhc

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

kuadrant-system

authorino-operator-7b7bb4bc77-v5xhc

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

authorino-operator-7b7bb4bc77-v5xhc

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-v5xhc to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69 to ip-10-0-133-249.us-east-2.compute.internal

opendatahub

test-curl-7240-875e8a

Scheduled

Successfully assigned opendatahub/test-curl-7240-875e8a to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-sl229

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-sl229 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

opendatahub

test-curl-7240-607ad6

Scheduled

Successfully assigned opendatahub/test-curl-7240-607ad6 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg to ip-10-0-143-206.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-c2m84

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-c2m84 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-stg9k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-stg9k to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-cgkbl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-cgkbl to ip-10-0-133-249.us-east-2.compute.internal

opendatahub

test-curl-7240-160ed4

Scheduled

Successfully assigned opendatahub/test-curl-7240-160ed4 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-tgdg9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-tgdg9 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-2zw4b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-2zw4b to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-w59hq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-w59hq to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-s6rgb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-s6rgb to ip-10-0-143-206.us-east-2.compute.internal

opendatahub

test-curl-7240-131870

Scheduled

Successfully assigned opendatahub/test-curl-7240-131870 to ip-10-0-132-83.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-pmwn5

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-pmwn5

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-pmwn5

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-pmwn5 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-jdmzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-jdmzx to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-kqh55

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-kqh55 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-7xb9w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-7xb9w to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-7wxj4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-7wxj4 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-rt24t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-rt24t to ip-10-0-143-206.us-east-2.compute.internal

opendatahub

test-curl-7240-01af22

Scheduled

Successfully assigned opendatahub/test-curl-7240-01af22 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8b3020-778c785455-7pqb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8b3020-778c785455-7pqb2 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-wpmx4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-wpmx4 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-ss9pl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-ss9pl to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-5tzq6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-5tzq6 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

test-curl-7237-99891e

Scheduled

Successfully assigned opendatahub/test-curl-7237-99891e to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-2qzd2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-2qzd2 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68d996c557dng2q

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-jobset-operator

jobset-operator-674cd59dc5-9g4dk

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-9g4dk to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68d996c557dng2q

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc to ip-10-0-143-206.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-t4sb5

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-t4sb5 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68d996c557dng2q

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

data-science-gateway-data-science-gateway-class-68d996c557dng2q

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68d996c557dng2q to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68d996c557ghsgt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68d996c557ghsgt to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68d996c557ghsgt

Preempted

Preempted by pod dac5ea76-74c5-41d8-82bc-8285bc87e535 on node ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-c44c86556-c65mk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-c44c86556-c65mk to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68d996c557ztrnm to ip-10-0-132-83.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-b5brh

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-b5brh to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp to ip-10-0-143-206.us-east-2.compute.internal

ai-tenants

e2e-api-a-0a2237

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-0a2237: MaasTenantConfig is not available to restore revocation operands

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-l8fcr

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-l8fcr to ip-10-0-133-249.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-zpphn

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-zpphn to ip-10-0-143-206.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-w9ppp

Preempted

Preempted by pod dcd7fddd-b34d-4947-80fc-b48f082004c8 on node ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-bk7cc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-bk7cc to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-dfd6g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-dfd6g to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm to ip-10-0-133-249.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-w9ppp

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-w9ppp to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx to ip-10-0-143-206.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-6b6mz

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-6b6mz to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-9746m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-9746m to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-45cts

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-45cts to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-47jq6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-47jq6 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw to ip-10-0-143-206.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-fz8hm

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-fz8hm to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-7xk9l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-7xk9l to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-nk64c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-nk64c to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4 to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-fzr95

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-fzr95 to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-fzr95

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

opendatahub

odh-model-controller-769875db56-fzr95

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dcrh4

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dcrh4

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dcrh4

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dcrh4

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-dcrh4 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-jobset-operator

jobset-controller-manager-5d9f95b69-x7n2b

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-5d9f95b69-x7n2b to ip-10-0-132-83.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-5d9f95b69-x7n2b

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-jobset-operator

jobset-controller-manager-5d9f95b69-x7n2b

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-slpzw

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-slpzw to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-fzr95

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-7b98bb678c-45rfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-45rfv to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-6dc578d85f-q59ph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6dc578d85f-q59ph to ip-10-0-132-83.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-5d9f95b69-x7n2b

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg to ip-10-0-132-83.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-5d9f95b69-9vwq7

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-5d9f95b69-9vwq7 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-76gw5

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-76gw5 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-cs7sz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-cs7sz to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-7clrt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-7clrt to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-hsr2v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-hsr2v to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

router-default-f7b87d695-dwgqt

Scheduled

Successfully assigned openshift-ingress/router-default-f7b87d695-dwgqt to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

router-default-f7b87d695-dwgqt

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node.

openshift-ingress

router-default-f7b87d695-dwgqt

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node.

openshift-ingress

router-default-f7b87d695-dwgqt

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu.

opendatahub

maas-controller-55f7f5fdbf-r82xn

Scheduled

Successfully assigned opendatahub/maas-controller-55f7f5fdbf-r82xn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-wmdcf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-wmdcf to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-gtfbc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-gtfbc to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-dl2t2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-dl2t2 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-pbsmc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-pbsmc to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-2nmsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-2nmsp to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-4ca23e-56f497sbsf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-4ca23e-56f497sbsf to ip-10-0-143-206.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-4p6wg

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-4p6wg to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-tf75l to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

router-default-f7b87d695-cwlfq

Scheduled

Successfully assigned openshift-ingress/router-default-f7b87d695-cwlfq to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

router-default-f7b87d695-cwlfq

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-f7b87d695-cwlfq

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-wz2w4 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

e2e-embedding-simulated-kserve-67bf594cd6-c2fbm

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-c2fbm to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt

Scheduled

Successfully assigned llm/e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9 to ip-10-0-132-83.us-east-2.compute.internal

ai-tenants

e2e-api-a-6a7dc9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-6a7dc9: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

Scheduled

Successfully assigned llm/e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65

Preempted

Preempted by pod 114f0567-5268-473e-aec5-50869958548c on node ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr to ip-10-0-132-83.us-east-2.compute.internal

llm

e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn

Scheduled

Successfully assigned llm/e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-d3d0df-c85975868-kxxcm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-d3d0df-c85975868-kxxcm to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74jm6r2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74jm6r2 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d747fkdr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d747fkdr to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d42w9pp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d42w9pp to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-88a18e-88bc6576-zdcn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-88a18e-88bc6576-zdcn4 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-bxvrr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-bxvrr to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-43c674-bf97746fd-vzmjm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-43c674-bf97746fd-vzmjm to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-nqjxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-nqjxm to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-942930-674dbf8f98-5tmhl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-942930-674dbf8f98-5tmhl to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-bfc240-76778fd956-68nbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-bfc240-76778fd956-68nbp to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq to ip-10-0-133-249.us-east-2.compute.internal

llm

e2e-same-id-a-2414e1ac

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-2414e1ac

llm

e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47

Scheduled

Successfully assigned llm/e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-zr84z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-zr84z to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-b8pcg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-b8pcg to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-f493f7-79fd656c6-s28fq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f493f7-79fd656c6-s28fq to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-c131fa-576cccf4c6-7tr7h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-c131fa-576cccf4c6-7tr7h to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-rgqgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-rgqgd to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-3faa07-7c8cbf956-bzf68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-3faa07-7c8cbf956-bzf68 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-t48bh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d8d238bf-85c6b5bff4-t48bh to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-sqjsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d8d238bf-85c6b5bff4-sqjsj to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm to ip-10-0-133-249.us-east-2.compute.internal

llm

e2e-same-id-b-2414e1ac

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-2414e1ac

llm

e2e-same-id-b-2414e1ac

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-fxm7k

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-fxm7k to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-5cf30a-openshift-default-64bb6488b5-999mz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-5cf30a-openshift-default-64bb6488b5-999mz to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-9b3619-749bcdcf58-4zzgj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9b3619-749bcdcf58-4zzgj to ip-10-0-143-206.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8b3020-7477b6db4b-rphdv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8b3020-7477b6db4b-rphdv to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-v7mcz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-v7mcz to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-3d1db1-96d59b748-wcl9q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3d1db1-96d59b748-wcl9q to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-kkqq7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-kkqq7 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-277dc9-b8848778d-2kslm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-277dc9-b8848778d-2kslm to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-kl2kh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-kl2kh to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-c6092e-cf9665854-xjmhw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c6092e-cf9665854-xjmhw to ip-10-0-143-206.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

Scheduled

Successfully assigned openshift-ingress/e2e-noten-a44263-openshift-default-668c89cc89-vx5cj to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-c6092e-548467b6bd-7gkz2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c6092e-548467b6bd-7gkz2 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-5mwmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-5mwmd to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-24w9z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-24w9z to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-xl2wz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-xl2wz to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-389e6d-777d766cf8-cwbm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-389e6d-777d766cf8-cwbm6 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47

Preempted

Preempted by pod f76f8240-ab05-410c-8a60-1d7b8cdde912 on node ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47 to ip-10-0-133-249.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-d7wsq

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-d7wsq to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-tz8fb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-tz8fb to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-d2aa3b-b894cb6db-7kg45

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d2aa3b-b894cb6db-7kg45 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-b503a8-7bf9b44576-cxrst

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-b503a8-7bf9b44576-cxrst to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-4c2a28-86b687fd6-z8rqf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-4c2a28-86b687fd6-z8rqf to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-46a6d7-fbf745886-grqvg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-46a6d7-fbf745886-grqvg to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-b4vbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-b4vbq to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-qj9lt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-qj9lt to ip-10-0-133-249.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-mnmjc

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

echo-simulator-kserve-64b6f8f96c-mnmjc

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

echo-simulator-kserve-64b6f8f96c-mnmjc

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

echo-simulator-kserve-64b6f8f96c-mnmjc

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-mnmjc to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-eb69cb-578f87d45d-slgsc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-eb69cb-578f87d45d-slgsc to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-krbks

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-krbks to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln to ip-10-0-132-83.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-phpvf

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-phpvf to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-8b7351-5fc98886d-twv27

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-8b7351-5fc98886d-twv27 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-33e267-7fb8df65fb-6ctzd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-33e267-7fb8df65fb-6ctzd to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-78d47a-568c4fc5dd-qjxxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-78d47a-568c4fc5dd-qjxxf to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

Preempted

Preempted by pod 916d26e6-67e4-49d7-9df8-18c7087aaac1 on node ip-10-0-143-206.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-hw2zm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-hw2zm to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ss6hd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ss6hd to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ww8r9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ww8r9 to ip-10-0-143-206.us-east-2.compute.internal

opendatahub

maas-controller-55c765799f-vxzm4

Scheduled

Successfully assigned opendatahub/maas-controller-55c765799f-vxzm4 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

Scheduled

Successfully assigned openshift-ingress/e2e-autores-36556d-openshift-default-658cbc6465-v6sm7 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-8c14f244-696d54c4dd-dzszn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8c14f244-696d54c4dd-dzszn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-36556d-f66cd46b-fz9td

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-36556d-f66cd46b-fz9td to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-f20fc0-5cdb8d9966-ks9fz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f20fc0-5cdb8d9966-ks9fz to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-dw4kb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-dw4kb to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-gp5ph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-gp5ph to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu.

openshift-ingress

e2e-autores-36556d-openshift-default-658cbc6465-p7qns

Scheduled

Successfully assigned openshift-ingress/e2e-autores-36556d-openshift-default-658cbc6465-p7qns to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node.

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node.

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2vf4r to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-8qktw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qktw to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-ad865c-67b7f75bdb-vwdkv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ad865c-67b7f75bdb-vwdkv to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-s97rd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-s97rd to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-29f633-fb468b56b-ns5qk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-29f633-fb468b56b-ns5qk to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-cc7720-658f6844c8-kdz97

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-cc7720-658f6844c8-kdz97 to ip-10-0-143-206.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-559cf8ccdf-ljnr4

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-559cf8ccdf-ljnr4 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-56bdcb5597-tcwmf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-56bdcb5597-tcwmf to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-c5b820-57f67f9dcd-dpfvh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c5b820-57f67f9dcd-dpfvh to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-b34f6c-78755bfcb6-q4txb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b34f6c-78755bfcb6-q4txb to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-ttrz9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-ttrz9 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-d790d69a-5c7d995866-ppm5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d790d69a-5c7d995866-ppm5h to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l5g9c to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu.

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node.

models-as-a-service

payload-processing-external-model-56cf4b877-vxgbr

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-56cf4b877-vxgbr to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

Scheduled

Successfully assigned openshift-ingress/e2e-autores-36556d-openshift-default-658cbc6465-nmhgk to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node.

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lcqfr to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lf9vc to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-ait-c20ed791-b89f7d964-5bsl7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c20ed791-b89f7d964-5bsl7 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-588d8bd94c-4cxs6

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-588d8bd94c-4cxs6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-588d8bd94c-4cxs6 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-rcpkf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rcpkf to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

Scheduled

Successfully assigned openshift-ingress/e2e-autores-36556d-openshift-default-658cbc6465-nlwxd to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-xr6ts

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xr6ts to ip-10-0-143-206.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-588d8bd94c-gd9x5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-588d8bd94c-mztcg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-ait-745a88f9-59fd8c46cd-k9x2l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-745a88f9-59fd8c46cd-k9x2l to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-36556d-openshift-default-658cbc6465-bzpxr to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

Preempted

Preempted by pod f76f8240-ab05-410c-8a60-1d7b8cdde912 on node ip-10-0-133-249.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-65759456-22sfn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-65759456-22sfn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-65759456-22sfn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-autores-36556d-openshift-default-658cbc6465-967xd

Scheduled

Successfully assigned openshift-ingress/e2e-autores-36556d-openshift-default-658cbc6465-967xd to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-79ddfb4884-rnf5q

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-79ddfb4884-rnf5q to ip-10-0-143-206.us-east-2.compute.internal

opendatahub

maas-controller-55c765799f-5qgk6

Scheduled

Successfully assigned opendatahub/maas-controller-55c765799f-5qgk6 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-79ddfb4884-vtwjp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-79ddfb4884-vtwjp to ip-10-0-133-249.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-65759456-sb7cs

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-65759456-sb7cs to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-9c77b64f4-hdd5s

Scheduled

Successfully assigned openshift-ingress/payload-processing-9c77b64f4-hdd5s to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

Scheduled

Successfully assigned openshift-ingress/e2e-autores-36556d-openshift-default-658cbc6465-5n8rn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

Preempted

Preempted by pod f76f8240-ab05-410c-8a60-1d7b8cdde912 on node ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

opendatahub

maas-controller-55c765799f-2bvrd

Scheduled

Successfully assigned opendatahub/maas-controller-55c765799f-2bvrd to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk to ip-10-0-132-83.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-65d589b9db-prrwd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-65d589b9db-prrwd to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c to ip-10-0-133-249.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-65d589b9db-w6g9t

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-65d589b9db-w6g9t to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth to ip-10-0-132-83.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6b644db666-cldhm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6b644db666-cldhm to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-788fcb4f8c-r8p9f

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-788fcb4f8c-r8p9f to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-processing-7bb9489676-x84lg

Scheduled

Successfully assigned openshift-ingress/payload-processing-7bb9489676-x84lg to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-processing-68d58ff5c7-z4hlv

Scheduled

Successfully assigned openshift-ingress/payload-processing-68d58ff5c7-z4hlv to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-464r7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-464r7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-464r7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-464r7 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-5sk9w

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-7988fb85f8-k9qwt

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-7988fb85f8-k9qwt

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-7988fb85f8-k9qwt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7988fb85f8-k9qwt to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-5sk9w

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-5sk9w

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-5sk9w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-5sk9w to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-78xj2

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-78xj2

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-79986d969f-ch5w8

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-79986d969f-ch5w8 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-7b855dbf87-6fjsr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-7b855dbf87-hdcld

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-78xj2

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-7b9c869b5c-vrt5q

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-78xj2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-78xj2 to ip-10-0-132-83.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-7fd6967f4c-t5nx9

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7fd6967f4c-t5nx9 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-7dmwc

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-7dmwc

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-7dmwc

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-7dmwc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-7dmwc to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-7krsk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-7krsk to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b to ip-10-0-133-249.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-86b5bf4bf-2jszb

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-86b5bf4bf-2jszb to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

Preempted

Preempted by pod 916d26e6-67e4-49d7-9df8-18c7087aaac1 on node ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-546nh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-546nh to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5 to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-8gzjz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-8gzjz to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb

Preempted

Preempted by pod dcd7fddd-b34d-4947-80fc-b48f082004c8 on node ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-9cvzn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-9cvzn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-cmtzs

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-cmtzs

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-cmtzs

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-cmtzs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-cmtzs to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

ai-gateway-controller-5d8dddb676-wn8zn

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5d8dddb676-wn8zn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-cnppr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-cnppr to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-g44hx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-g44hx to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-g6xz7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-g6xz7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-g6xz7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-g6xz7 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-kqcwg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-kqcwg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

opendatahub

ai-gateway-controller-79b8b796f-2sshp

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-79b8b796f-2sshp to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-kqcwg to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Preempted

Preempted by pod dac5ea76-74c5-41d8-82bc-8285bc87e535 on node ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Preempted

Preempted by pod 114f0567-5268-473e-aec5-50869958548c on node ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-lm9zq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-lm9zq to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

Preempted

Preempted by pod f76f8240-ab05-410c-8a60-1d7b8cdde912 on node ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

opendatahub

kserve-controller-manager-776cc66d47-vx6gv

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-vx6gv to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-mrwmt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-mrwmt to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-nt297

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-nt297

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-nt297

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-nt297

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-nt297 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-t8m7q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-t8m7q to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

Preempted

Preempted by pod 916d26e6-67e4-49d7-9df8-18c7087aaac1 on node ip-10-0-143-206.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-fxxs9

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-fxxs9 to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-tnfsk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-tnfsk to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr to ip-10-0-143-206.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-qkjdd

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-qkjdd to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-tsrbh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-tsrbh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-tsrbh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-tsrbh to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-vkx59

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-vkx59 to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-vznnm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-vznnm to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48 to ip-10-0-132-83.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-xbjmp

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-xbjmp to ip-10-0-133-249.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-wtlgc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-wtlgc to ip-10-0-132-83.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-x4bds

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-x4bds to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-855f9574cf-zst5d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-zst5d to ip-10-0-143-206.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

FailedScheduling

0/3 nodes are available: 1 node(s) had untolerated taint(s), 2 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-f7b87d695 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-f7b87d695

SuccessfulCreate

Created pod: router-default-f7b87d695-cwlfq
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

Started

Container started

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

Created

Container created

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-f7b87d695-cwlfq

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hw2zm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-hw2zm

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-hw2zm

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hw2zm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.707s (3.707s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hw2zm

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hw2zm

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-tnfsk
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hw2zm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hw2zm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-855f9574cf from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-9b4747bc from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-9b4747bc

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-tnfsk

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.568s (4.568s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.154s (7.154s including waiting). Image size: 183555333 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-9g4dk
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9g4dk

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-9g4dk

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9g4dk

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.358s (2.358s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9g4dk

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9g4dk

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-9g4dk_95391949-7f38-4e3a-8e93-2c059f0a1710 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8464c976fd

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8464c976fd-9b8p5

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-8464c976fd from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8464c976fd

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8464c976fd-cpxbn

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8464c976fd

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8464c976fd-8g6hn

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8464c976fd-cpxbn

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8464c976fd-9b8p5

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8464c976fd-8g6hn

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.238s (3.238s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.019s (4.019s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.913s (3.913s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 399ms (399ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-9b8p5_d174c1ed-bdee-41f0-aa45-4cdce2dbd1b5

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-8464c976fd-9b8p5_d174c1ed-bdee-41f0-aa45-4cdce2dbd1b5 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Created

Container created

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-slpzw

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 378ms (378ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-8g6hn

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 403ms (403ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-cpxbn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-slpzw

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-slpzw

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-slpzw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.809s (2.809s including waiting). Image size: 177967631 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-6fd2v

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

kuadrant-system

limitador-operator-controller-manager-5778bb4449-slpzw_5c5f85a1-e8ca-4f62-add9-528ec3ea2af8

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-slpzw_5c5f85a1-e8ca-4f62-add9-528ec3ea2af8 became leader

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-l8fcr

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-l8fcr

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-l8fcr

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-l8fcr_c9879138-c412-47a5-88ba-805880e5f14f

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-l8fcr_c9879138-c412-47a5-88ba-805880e5f14f became leader

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-nj52h

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-l8fcr

Created

Container created

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-l8fcr

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-l8fcr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.157s (4.157s including waiting). Image size: 424244516 bytes.

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

multus

authorino-operator-7b7bb4bc77-nj52h

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-nj52h

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-t4sb5

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4sb5

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-t4sb5

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

kuadrant-system

authorino-operator-7b7bb4bc77-nj52h_f964b986-9c62-433e-8431-331319faab23

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-nj52h_f964b986-9c62-433e-8431-331319faab23 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-nj52h

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-nj52h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.759s (1.759s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-nj52h

Started

Container started

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-c2m84

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-c2m84

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-c2m84

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4sb5

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4sb5

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4sb5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.576s (4.576s including waiting). Image size: 342538866 bytes.
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

kuadrant-system

dns-operator-controller-manager-8557cbdb84-c2m84_bd85da6e-ba51-48b3-81f2-d5acba0f536f

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-c2m84_bd85da6e-ba51-48b3-81f2-d5acba0f536f became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-c2m84

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.748s (1.748s including waiting). Image size: 190804149 bytes.

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-59rwc

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-k47sq

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-59rwc

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-59rwc

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-k47sq

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-k47sq

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-59rwc

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-59rwc

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.713s (2.713s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-59rwc

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-k47sq

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-k47sq

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.868s (2.869s including waiting). Image size: 309650901 bytes.

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-k47sq

Created

Container created
(x10)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-c8rm9

cert-manager

kubelet

cert-manager-597b95cb84-c8rm9

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-c8rm9

Started

Container started

cert-manager

multus

cert-manager-597b95cb84-c8rm9

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-c8rm9

Created

Container created

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-79ddfb4884 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-79ddfb4884

SuccessfulCreate

Created pod: kube-auth-proxy-79ddfb4884-rnf5q

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-79ddfb4884

SuccessfulCreate

Created pod: kube-auth-proxy-79ddfb4884-vtwjp

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-ingress

kubelet

kube-auth-proxy-79ddfb4884-vtwjp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68d996c557

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68d996c557ztrnm

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

Created

Container created

openshift-ingress

multus

kube-auth-proxy-79ddfb4884-vtwjp

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-79ddfb4884-rnf5q

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-6b6mz

openshift-ingress

multus

kube-auth-proxy-79ddfb4884-rnf5q

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68d996c557 from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

Started

Container started

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-fz8hm

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-fz8hm

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

multus

limitador-limitador-7c9b87d574-fz8hm

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b6mz

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-6b6mz

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-cshnh

kuadrant-system

kubelet

authorino-57f7f8659f-cshnh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-cshnh

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-x5lg7

kuadrant-system

kubelet

authorino-56c6c9ddd5-x5lg7

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

multus

authorino-56c6c9ddd5-x5lg7

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-79ddfb4884-vtwjp

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-79ddfb4884-vtwjp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.679s (2.679s including waiting). Image size: 188904677 bytes.

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-fxxs9

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b6mz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.822s (1.822s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b6mz

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b6mz

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-79ddfb4884-rnf5q

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-79ddfb4884-rnf5q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.614s (2.614s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-79ddfb4884-rnf5q

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-79ddfb4884-vtwjp

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-fz8hm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.878s (2.878s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-fz8hm

Created

Container created

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-fxxs9

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-fxxs9

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-fz8hm

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-x5lg7

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-fxxs9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.178s (2.178s including waiting). Image size: 195729000 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-x5lg7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.381s (3.381s including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-cshnh

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-x5lg7

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-fxxs9

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-fxxs9

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-cshnh

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-cshnh

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-57f7f8659f-cshnh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 5.829s (5.829s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-cshnh

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b6mz

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-6b6mz

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-9dvqm"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

opendatahub

kserve-module-controller-manager-7566cf5fc8-fxxs9_515edd81-0752-427d-a10b-37a376a5ea24

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-fxxs9_515edd81-0752-427d-a10b-37a376a5ea24 became leader

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-bg97v"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-5d9f95b69 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-5d9f95b69

SuccessfulCreate

Created pod: jobset-controller-manager-5d9f95b69-9vwq7

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-5d9f95b69-9vwq7

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

maas-controller-55f7f5fdbf

SuccessfulCreate

Created pod: maas-controller-55f7f5fdbf-r82xn

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-55f7f5fdbf from 0 to 1

opendatahub

replicaset-controller

maas-controller-55c765799f

SuccessfulCreate

Created pod: maas-controller-55c765799f-2bvrd

opendatahub

multus

maas-controller-55f7f5fdbf-r82xn

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-55f7f5fdbf-r82xn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8ac03c5476dd0d483a2206237a332a7e6ee25bd74443678b4dc8ed1b938d2cc0"

opendatahub

multus

maas-controller-55c765799f-2bvrd

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-55c765799f-2bvrd

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8ac03c5476dd0d483a2206237a332a7e6ee25bd74443678b4dc8ed1b938d2cc0"

opendatahub

maas-controller-55c765799f-2bvrd_6b6b91eb-41ad-4d63-b06f-edd53eda4d00

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-55c765799f-2bvrd_6b6b91eb-41ad-4d63-b06f-edd53eda4d00 became leader

opendatahub

kubelet

maas-controller-55c765799f-2bvrd

Started

Container started

opendatahub

kubelet

maas-controller-55f7f5fdbf-r82xn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8ac03c5476dd0d483a2206237a332a7e6ee25bd74443678b4dc8ed1b938d2cc0" in 3.545s (3.545s including waiting). Image size: 200095242 bytes.

opendatahub

kubelet

maas-controller-55f7f5fdbf-r82xn

Created

Container created

opendatahub

kubelet

maas-controller-55f7f5fdbf-r82xn

Started

Container started

opendatahub

kubelet

maas-controller-55c765799f-2bvrd

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8ac03c5476dd0d483a2206237a332a7e6ee25bd74443678b4dc8ed1b938d2cc0" in 3.05s (3.05s including waiting). Image size: 200095242 bytes.

opendatahub

kubelet

maas-controller-55c765799f-2bvrd

Created

Container created

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-564sz

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-564sz

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-564sz

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 31.401s (31.401s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

jobset-controller-manager-5d9f95b69-9vwq7_ddadd5e4-5a2d-453a-a4aa-f97938189681

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-5d9f95b69-9vwq7_ddadd5e4-5a2d-453a-a4aa-f97938189681 became leader

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-vx6gv

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-xbjmp

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-76gw5

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-xr6ts

opendatahub

multus

model-serving-api-75bd89fdfc-76gw5

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xbjmp

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-xbjmp

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-zpphn

opendatahub

multus

kserve-controller-manager-776cc66d47-vx6gv

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

opendatahub

multus

odh-model-controller-769875db56-zpphn

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-55f7f5fdbf-r82xn

Killing

Stopping container manager

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

maas-controller-55f7f5fdbf

SuccessfulDelete

Deleted pod: maas-controller-55f7f5fdbf-r82xn

opendatahub

kubelet

odh-model-controller-769875db56-zpphn

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

kubelet

model-serving-api-75bd89fdfc-76gw5

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-55f7f5fdbf from 1 to 0

opendatahub

kubelet

kserve-controller-manager-776cc66d47-vx6gv

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr6ts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-xr6ts

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr6ts

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr6ts

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-hw2zm

opendatahub

kubelet

model-serving-api-75bd89fdfc-76gw5

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-76gw5

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-76gw5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.197s (2.197s including waiting). Image size: 184925761 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hw2zm

Killing

Stopping container discovery

opendatahub

kubelet

kserve-controller-manager-776cc66d47-vx6gv

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-zpphn

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-vx6gv

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-vx6gv

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.851s (2.851s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xbjmp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.442s (2.442s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xbjmp

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xbjmp

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-vx6gv_b6c71a57-5590-4f6d-8b01-5ac2caef0a1d

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-vx6gv_b6c71a57-5590-4f6d-8b01-5ac2caef0a1d became leader

opendatahub

kubelet

odh-model-controller-769875db56-zpphn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.129s (3.129s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-zpphn

Created

Container created

opendatahub

odh-model-controller-769875db56-zpphn_b2da1d59-536d-4f60-ba64-59d50be471c3

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-zpphn_b2da1d59-536d-4f60-ba64-59d50be471c3 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-xbjmp_6ea955c6-17e8-47ae-9ed9-89759d2e7af8

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-xbjmp_6ea955c6-17e8-47ae-9ed9-89759d2e7af8 became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-564sz

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-564sz

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 15.396s (15.396s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-564sz

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6dd76875b5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulCreate

Created pod: authorino-6dd76875b5-sf54c

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-nlh5d

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulDelete

Deleted pod: authorino-6dd76875b5-sf54c

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6dd76875b5 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-77f7f55747 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

kubelet

authorino-77f7f55747-slnb6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6889cbd8c4-nlh5d

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-nlh5d

kuadrant-system

multus

authorino-77f7f55747-slnb6

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-77f7f55747

SuccessfulCreate

Created pod: authorino-77f7f55747-slnb6

kuadrant-system

multus

authorino-6889cbd8c4-nlh5d

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-77f7f55747-slnb6

Created

Container created

kuadrant-system

kubelet

authorino-77f7f55747-slnb6

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-nlh5d

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 744ms (744ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-nlh5d

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-nlh5d

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-nlh5d

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-77f7f55747-slnb6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 767ms (767ms including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-x5lg7
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

ProbeError

Startup probe error: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused body:

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-x5lg7

Killing

Stopping container authorino
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

Unhealthy

Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-qkjdd

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-6466c554d8-qkjdd

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-qkjdd

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-qkjdd

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-qkjdd

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-qkjdd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 368ms (368ms including waiting). Image size: 235100981 bytes.

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-xbjmp

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xbjmp

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulCreate

Created pod: ai-gateway-controller-5d8dddb676-wn8zn

opendatahub

llmisvc-controller-manager-6466c554d8-qkjdd_931f7c46-af70-43f3-88e7-9ca31029cbe0

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-qkjdd_931f7c46-af70-43f3-88e7-9ca31029cbe0 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5d8dddb676 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-wn8zn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-5d8dddb676-wn8zn

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-wn8zn

Started

Container started

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-wn8zn

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-wn8zn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 3.31s (3.31s including waiting). Image size: 183992228 bytes.

opendatahub

ai-gateway-controller-5d8dddb676-wn8zn_cfcd5fcb-5fcc-4535-82b4-e0fa11920f71

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5d8dddb676-wn8zn_cfcd5fcb-5fcc-4535-82b4-e0fa11920f71 became leader
(x5)

openshift-ingress

replicaset-controller

payload-processing-7bb9489676

FailedCreate

Error creating: pods "payload-processing-7bb9489676-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-45rfv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-7bb9489676

SuccessfulCreate

Created pod: payload-processing-7bb9489676-x84lg

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-7bb9489676 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-45rfv

openshift-ingress

multus

payload-processing-7bb9489676-x84lg

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-45rfv

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-7bb9489676-x84lg

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-7bb9489676-x84lg

Created

Container created

openshift-ingress

kubelet

payload-processing-7bb9489676-x84lg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-45rfv

Started

Container started

openshift-ingress

kubelet

payload-processing-7bb9489676-x84lg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.372s (2.372s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-45rfv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.326s (2.326s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-45rfv

Created

Container created

opendatahub

replicaset-controller

ai-gateway-controller-79b8b796f

SuccessfulCreate

Created pod: ai-gateway-controller-79b8b796f-2sshp

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-79b8b796f from 0 to 1

opendatahub

kubelet

ai-gateway-controller-79b8b796f-2sshp

Created

Container created

opendatahub

multus

ai-gateway-controller-79b8b796f-2sshp

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-79b8b796f-2sshp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-79b8b796f-2sshp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 451ms (451ms including waiting). Image size: 183992228 bytes.

opendatahub

kubelet

ai-gateway-controller-79b8b796f-2sshp

Started

Container started

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-5d8dddb676 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-wn8zn

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulDelete

Deleted pod: ai-gateway-controller-5d8dddb676-wn8zn

opendatahub

ai-gateway-controller-79b8b796f-2sshp_969a976f-ea70-4527-9ca3-8d1df8f3f1f9

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-79b8b796f-2sshp_969a976f-ea70-4527-9ca3-8d1df8f3f1f9 became leader

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-4p6wg

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-4p6wg

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-4p6wg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-4p6wg

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-4p6wg

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-4p6wg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.432s (1.433s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-tf75l

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-c2fbm

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-c2fbm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-c2fbm

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-fxm7k

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-c2fbm

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-c2fbm

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-c2fbm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 318ms (318ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.338s (1.338s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-fxm7k

Started

Container started

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-fxm7k

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-fxm7k

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 334ms (334ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-fxm7k

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-fxm7k

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 325ms (325ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-d7wsq

llm

kubelet

echo-simulator-kserve-64b6f8f96c-d7wsq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-d7wsq

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-krbks

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-krbks

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-krbks

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-krbks

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-krbks

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 318ms (318ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-krbks

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-d7wsq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.761s (1.761s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-d7wsq

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-d7wsq

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 283ms (283ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

kuadrant-system

replicaset-controller

authorino-66b59d468d

SuccessfulCreate

Created pod: authorino-66b59d468d-5bfd2

kuadrant-system

kubelet

authorino-66b59d468d-5bfd2

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-66b59d468d-5bfd2

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-66b59d468d-5bfd2

Created

Container created

kuadrant-system

kubelet

authorino-66b59d468d-5bfd2

Started

Container started

kuadrant-system

kubelet

authorino-77f7f55747-slnb6

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-77f7f55747

SuccessfulDelete

Deleted pod: authorino-77f7f55747-slnb6
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-77f7f55747 from 1 to 0

kuadrant-system

kubelet

authorino-66b59d468d-5bfd2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 627ms (627ms including waiting). Image size: 204096810 bytes.

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-cnppr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-vznnm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-mrwmt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-855f9574cf from 1 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cnppr

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-cnppr

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-vznnm

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cnppr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-mrwmt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-mrwmt

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cnppr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-mrwmt

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cnppr

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-mrwmt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.658s (7.658s including waiting). Image size: 183555333 bytes.
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cnppr

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-mrwmt

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-855f9574cf from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-g44hx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-9cvzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g44hx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-9cvzn

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-g44hx

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-9cvzn
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-mrwmt

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-mrwmt

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g44hx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g44hx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-9cvzn

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-9cvzn

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g44hx

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-9cvzn

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-9cvzn

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g44hx

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-745a88f9-openshift-default-7fd449db85

SuccessfulCreate

Created pod: e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

openshift-ingress

deployment-controller

e2e-ait-745a88f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-745a88f9-openshift-default-7fd449db85 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-745a88f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-745a88f9

openshift-ingress

gateway_labeler_controller

e2e-ait-c20ed791

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c20ed791

openshift-ingress

deployment-controller

e2e-ait-c20ed791-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c20ed791-openshift-default-7ff69c5dc9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-c20ed791-openshift-default-7ff69c5dc9

SuccessfulCreate

Created pod: e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

openshift-ingress

multus

e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-9959e5f4-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-9959e5f4-gw

openshift-ingress

multus

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c

SuccessfulCreate

Created pod: e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

openshift-ingress

deployment-controller

e2e-migrate-9959e5f4-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-3f7e10b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3f7e10b8

openshift-ingress

replicaset-controller

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7

SuccessfulCreate

Created pod: e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

openshift-ingress

deployment-controller

e2e-ait-3f7e10b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7 from 0 to 1

openshift-ingress

multus

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c20ed791-b89f7d964

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c20ed791-b89f7d964-5bsl7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c20ed791

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c20ed791-649568bc75 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c20ed791-649568bc75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c20ed791-649568bc75-gnp7d

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c20ed791

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c20ed791-b89f7d964 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c20ed791-b89f7d964

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c20ed791-b89f7d964-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c20ed791: serviceaccount "payload-processing-e2e-ait-c20ed791" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c20ed791-649568bc75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c20ed791-649568bc75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c20ed791: serviceaccount "payload-processing-e2e-ait-c20ed791" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-745a88f9-59fd8c46cd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-745a88f9-59fd8c46cd-k9x2l

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c20ed791-649568bc75-gnp7d

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-745a88f9-55f698d8f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-745a88f9: serviceaccount "payload-processing-e2e-ait-745a88f9" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-c20ed791-b89f7d964-5bsl7

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-745a88f9-55f698d8f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-2qzd2

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c20ed791-649568bc75-gnp7d

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-745a88f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-745a88f9-55f698d8f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-c20ed791-b89f7d964-5bsl7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-c20ed791-b89f7d964-5bsl7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-c20ed791-b89f7d964-5bsl7

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-745a88f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-745a88f9-59fd8c46cd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-c20ed791-649568bc75-gnp7d

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-745a88f9-59fd8c46cd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-745a88f9-59fd8c46cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-745a88f9: serviceaccount "payload-processing-e2e-ait-745a88f9" not found

openshift-ingress

multus

payload-processing-e2e-ait-745a88f9-59fd8c46cd-k9x2l

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-745a88f9-59fd8c46cd-k9x2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-2qzd2

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-2qzd2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c20ed791-649568bc75-gnp7d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-745a88f9-59fd8c46cd-k9x2l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-745a88f9-59fd8c46cd-k9x2l

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9959e5f4: serviceaccount "payload-processing-e2e-migrate-9959e5f4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-9959e5f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9959e5f4-6488566cf6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9959e5f4-6488566cf6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-9959e5f4-6488566cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9959e5f4: serviceaccount "payload-processing-e2e-migrate-9959e5f4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-9959e5f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-9959e5f4-6488566cf6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-2qzd2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-2qzd2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3f7e10b8: serviceaccount "payload-processing-e2e-ait-3f7e10b8" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3f7e10b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3f7e10b8: serviceaccount "payload-processing-e2e-ait-3f7e10b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3f7e10b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3f7e10b8-6dd8f5869d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

e2e-derive-8c14f244-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8c14f244-openshift-default-9bfc77fc7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-8c14f244-openshift-default-9bfc77fc7

SuccessfulCreate

Created pod: e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

openshift-ingress

gateway_labeler_controller

e2e-derive-8c14f244

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8c14f244

openshift-ingress

kubelet

payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.562s (3.562s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.626s (3.626s including waiting). Image size: 125353963 bytes.

openshift-ingress

multus

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.194s (3.194s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.211s (3.212s including waiting). Image size: 125353963 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8c14f244

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8c14f244-696d54c4dd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8c14f244-696d54c4dd

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8c14f244-696d54c4dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8c14f244: serviceaccount "payload-processing-e2e-derive-8c14f244" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8c14f244

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8c14f244-656fd8c655 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8c14f244-656fd8c655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8c14f244-656fd8c655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8c14f244: serviceaccount "payload-processing-e2e-derive-8c14f244" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8c14f244-696d54c4dd

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8c14f244-696d54c4dd-dzszn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8c14f244-656fd8c655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8c14f244-656fd8c655-c4l2m

openshift-ingress

kubelet

payload-processing-e2e-derive-8c14f244-696d54c4dd-dzszn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8c14f244-656fd8c655-c4l2m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-8c14f244-696d54c4dd-dzszn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8c14f244-656fd8c655-c4l2m

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-8c14f244-696d54c4dd-dzszn

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-8c14f244-696d54c4dd-dzszn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8c14f244-656fd8c655-c4l2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-8c14f244-656fd8c655-c4l2m

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-745a88f9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-745a88f9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-8c14f244-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-8c14f244-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c20ed791-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c20ed791-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-9959e5f4-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-9959e5f4-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-745a88f9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-745a88f9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3f7e10b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3f7e10b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9959e5f4-7564dbc89f-8vl4b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-9959e5f4-6488566cf6-9gscp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-745a88f9-55f698d8f9-2qzd2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-745a88f9-59fd8c46cd-k9x2l

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-3f7e10b8-6dd8f5869d-tkccf

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f7e10b8-7c7f97f9-h8rsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-745a88f9-openshift-default-7fd449db85-wj6bb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-c20ed791-b89f7d964-5bsl7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-8c14f244-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-2b5703

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-2b5703

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c20ed791-649568bc75-gnp7d

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-8c14f244-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 0 to 1

openshift-ingress

kubelet

e2e-ait-3f7e10b8-openshift-default-78c6f9c4f7-zgtvr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-9f46e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-9f46e5

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-d3d0df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-d3d0df

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8c14f244-656fd8c655-c4l2m

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

openshift-ingress

kubelet

payload-processing-e2e-derive-8c14f244-696d54c4dd-dzszn

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-9959e5f4-gw-openshift-default-c5d65d75c-h47mx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-8c14f244-openshift-default-9bfc77fc7-lz4lv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-c20ed791-openshift-default-7ff69c5dc9-l6z2f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-9f46e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-3fbb1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-3fbb1a

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-32e482

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-32e482

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-9f46e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9f46e5: serviceaccount "payload-processing-e2e-worker-w3-9f46e5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9f46e5: serviceaccount "payload-processing-e2e-worker-w3-9f46e5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-2b5703-7c44b968cb

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-2b5703-7c44b968cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-2b5703: serviceaccount "payload-processing-e2e-worker-w2-2b5703" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-2b5703-7c44b968cb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-2b5703

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-2b5703-7c44b968cb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-2b5703

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-546nh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-2b5703: serviceaccount "payload-processing-e2e-worker-w2-2b5703" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 0 to 1

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-546nh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-546nh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-546nh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-546nh

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-d3d0df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-d3d0df-c85975868 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-dw4kb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-d3d0df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d3d0df-c85975868

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-d3d0df-c85975868-kxxcm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d3d0df: serviceaccount "payload-processing-e2e-worker-w0-d3d0df" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d3d0df-c85975868

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-d3d0df-c85975868-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d3d0df: serviceaccount "payload-processing-e2e-worker-w0-d3d0df" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-d3d0df-c85975868-kxxcm

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-dw4kb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-dw4kb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-dw4kb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-dw4kb

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d3d0df-c85975868-kxxcm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d3d0df-c85975868-kxxcm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d3d0df-c85975868-kxxcm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-32e482: serviceaccount "payload-processing-e2e-worker-w1-32e482" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-3fbb1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-3fbb1a-755f448d4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-32e482-5647cf6c5b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-32e482-5647cf6c5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-32e482: serviceaccount "payload-processing-e2e-worker-w1-32e482" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-32e482-5647cf6c5b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3fbb1a-755f448d4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3fbb1a-755f448d4

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-3fbb1a-755f448d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-3fbb1a: serviceaccount "payload-processing-e2e-worker-w4-3fbb1a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-3fbb1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-32e482

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-32e482-5647cf6c5b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-3fbb1a: serviceaccount "payload-processing-e2e-worker-w4-3fbb1a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-32e482

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-32e482-5799655ddc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

Started

Container started

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Created

Container created

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

Started

Container started

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 1 to 2

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 1 to 2

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

Started

Container started

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6b644db666 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-6b644db666

SuccessfulCreate

Created pod: payload-processing-external-model-6b644db666-cldhm
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-6b644db666

FailedCreate

Error creating: pods "payload-processing-external-model-6b644db666-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-6b644db666-cldhm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6b644db666-cldhm

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6b644db666-cldhm

Created

Container created

models-as-a-service

multus

payload-processing-external-model-6b644db666-cldhm

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 2 to 3

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-559cf8ccdf from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-559cf8ccdf-ljnr4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-559cf8ccdf-ljnr4

Started

Container started

models-as-a-service

multus

payload-processing-external-model-559cf8ccdf-ljnr4

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-559cf8ccdf

SuccessfulCreate

Created pod: payload-processing-external-model-559cf8ccdf-ljnr4

models-as-a-service

kubelet

payload-processing-external-model-559cf8ccdf-ljnr4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-zst5d

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-855f9574cf-t8m7q

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-7krsk

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-zst5d

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-7krsk

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-lm9zq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-zst5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-lm9zq

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-lm9zq

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-t8m7q

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-t8m7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-t8m7q

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-t8m7q

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-lm9zq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-zst5d

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-zst5d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-lm9zq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6b644db666 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-6b644db666-cldhm

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-6b644db666

SuccessfulDelete

Deleted pod: payload-processing-external-model-6b644db666-cldhm
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-t8m7q

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-lm9zq

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-lm9zq

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-zst5d

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-t8m7q

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-zst5d

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6b644db666-cldhm

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.87:50052" within 1s: context deadline exceeded

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 3 to 5

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

Created

Container created

models-as-a-service

multus

payload-processing-external-model-65d589b9db-w6g9t

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-65d589b9db-w6g9t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-65d589b9db

SuccessfulCreate

Created pod: payload-processing-external-model-65d589b9db-w6g9t

models-as-a-service

kubelet

payload-processing-external-model-65d589b9db-w6g9t

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-65d589b9db-w6g9t

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-559cf8ccdf from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-559cf8ccdf

SuccessfulDelete

Deleted pod: payload-processing-external-model-559cf8ccdf-ljnr4

models-as-a-service

kubelet

payload-processing-external-model-559cf8ccdf-ljnr4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 5 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

Started

Container started

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

Created

Container created

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-79986d969f from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-79986d969f

SuccessfulCreate

Created pod: payload-processing-external-model-79986d969f-ch5w8

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-79986d969f-ch5w8

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-79986d969f-ch5w8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-79986d969f-ch5w8

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-79986d969f-ch5w8

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

Created

Container created

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-65d589b9db from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-65d589b9db

SuccessfulDelete

Deleted pod: payload-processing-external-model-65d589b9db-w6g9t

models-as-a-service

kubelet

payload-processing-external-model-65d589b9db-w6g9t

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-lf9vc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

Started

Container started

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 6.878s (6.878s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-65d589b9db

SuccessfulCreate

Created pod: payload-processing-external-model-65d589b9db-prrwd
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-65d589b9db from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-65d589b9db-prrwd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-65d589b9db-prrwd

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-65d589b9db-prrwd

Started

Container started

models-as-a-service

multus

payload-processing-external-model-65d589b9db-prrwd

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-79986d969f-ch5w8

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-65d589b9db-prrwd

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Created

Container created
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

Started

Container started

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

Created

Container created

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

Created

Container created

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Unhealthy

Liveness probe failed: Get "https://10.132.0.51:8000/health": context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

Started

Container started

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

Started

Container started

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

Started

Container started

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

Unhealthy

Startup probe failed: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

ProbeError

Startup probe error: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-d8d238bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d8d238bf

openshift-ingress

replicaset-controller

e2e-mt-d8d238bf-openshift-default-6d47dc76f7

SuccessfulCreate

Created pod: e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

openshift-ingress

deployment-controller

e2e-mt-d8d238bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d8d238bf-openshift-default-6d47dc76f7 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 8 to 9
(x4)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d8d238bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d8d238bf-575d65cbff from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d8d238bf-85c6b5bff4

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d8d238bf-85c6b5bff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d8d238bf: serviceaccount "payload-processing-e2e-mt-d8d238bf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d8d238bf-85c6b5bff4

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d8d238bf-85c6b5bff4-sqjsj

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d8d238bf: serviceaccount "payload-processing-e2e-mt-d8d238bf" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d8d238bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d8d238bf-85c6b5bff4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-sqjsj

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-sqjsj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-dfd6g

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-sqjsj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-dfd6g

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-dfd6g

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-dfd6g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-dfd6g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-sqjsj

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

ProbeError

Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

Unhealthy

Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

Unhealthy

Readiness probe failed: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

ProbeError

Readiness probe error: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

Started

Container started

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-a-cc7720-openshift-default-564f96dcc7

SuccessfulCreate

Created pod: e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

openshift-ingress

deployment-controller

e2e-api-a-cc7720-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-cc7720-openshift-default-564f96dcc7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-cc7720

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-cc7720

openshift-ingress

multus

e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 9 to 10

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

ProbeError

Startup probe error: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

Unhealthy

Startup probe failed: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-a-0a2237-openshift-default-c9b5bf779

SuccessfulCreate

Created pod: e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

openshift-ingress

gateway_labeler_controller

e2e-api-a-0a2237

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-0a2237

openshift-ingress

deployment-controller

e2e-api-a-0a2237-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-0a2237-openshift-default-c9b5bf779 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-cc7720

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-cc7720-658f6844c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cc7720-7464f494bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-cc7720-7464f494bc-rjzsz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cc7720-7464f494bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-cc7720-7464f494bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cc7720: serviceaccount "payload-processing-e2e-api-a-cc7720" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cc7720-658f6844c8

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-cc7720-658f6844c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cc7720: serviceaccount "payload-processing-e2e-api-a-cc7720" not found

openshift-ingress

multus

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cc7720-658f6844c8

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-cc7720-658f6844c8-kdz97

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-cc7720

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-cc7720-7464f494bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-cc7720-658f6844c8-kdz97

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-cc7720-658f6844c8-kdz97

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-cc7720-658f6844c8-kdz97

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cc7720-7464f494bc-rjzsz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-cc7720-658f6844c8-kdz97

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-cc7720-7464f494bc-rjzsz

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cc7720-7464f494bc-rjzsz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cc7720-7464f494bc-rjzsz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

ProbeError

Readiness probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0a2237-85f764d744

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0a2237-867f7ff655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-0a2237-867f7ff655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0a2237: serviceaccount "payload-processing-e2e-api-a-0a2237" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-0a2237

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-0a2237-867f7ff655 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0a2237-85f764d744

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-0a2237-85f764d744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0a2237: serviceaccount "payload-processing-e2e-api-a-0a2237" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-0a2237

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-0a2237-85f764d744 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0a2237-867f7ff655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-0a2237-867f7ff655-k2kck
(x3)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

Unhealthy

Readiness probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0a2237-867f7ff655-k2kck

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-api-a-0a2237-867f7ff655-k2kck

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0a2237-867f7ff655-k2kck

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0a2237-867f7ff655-k2kck

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d8d238bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d8d238bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.708s (2.708s including waiting). Image size: 125353963 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d8d238bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d8d238bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-b-ad865c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ad865c

openshift-ingress

deployment-controller

e2e-api-b-ad865c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-ad865c-openshift-default-6585d5cdd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-ad865c-openshift-default-6585d5cdd9

SuccessfulCreate

Created pod: e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

openshift-ingress

multus

e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-8qktw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-8qktw

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8qktw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

ProbeError

Readiness probe error: Get "http://10.132.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ad865c: serviceaccount "payload-processing-e2e-api-b-ad865c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-nbncx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-ad865c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ad865c-67b7f75bdb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-ad865c-67b7f75bdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ad865c: serviceaccount "payload-processing-e2e-api-b-ad865c" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8qktw

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8qktw

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8qktw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.129s (3.129s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

Unhealthy

Readiness probe failed: Get "http://10.132.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-ad865c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-ad865c-67b7f75bdb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ad865c-67b7f75bdb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-ad865c-67b7f75bdb-vwdkv

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8qktw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-nbncx

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-f20fc0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f20fc0-openshift-default-5b67979f5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-f20fc0-openshift-default-5b67979f5c

SuccessfulCreate

Created pod: e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

openshift-ingress

kubelet

payload-processing-e2e-api-b-ad865c-67b7f75bdb-vwdkv

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-f20fc0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f20fc0

openshift-ingress

kubelet

payload-processing-e2e-api-b-ad865c-67b7f75bdb-vwdkv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-ad865c-67b7f75bdb-vwdkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-nbncx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-ad865c-67b7f75bdb-vwdkv

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8qktw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-nbncx

Created

Container created

openshift-ingress

multus

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-nbncx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f20fc0-5cdb8d9966

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f20fc0-5cdb8d9966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f20fc0: serviceaccount "payload-processing-e2e-api-b-f20fc0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f20fc0-5cdb8d9966

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f20fc0-5cdb8d9966-ks9fz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f20fc0-89489b479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f20fc0-89489b479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f20fc0: serviceaccount "payload-processing-e2e-api-b-f20fc0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f20fc0-89489b479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f20fc0-89489b479-5h6bb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f20fc0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f20fc0-89489b479 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f20fc0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f20fc0-5cdb8d9966 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-f20fc0-5cdb8d9966-ks9fz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-f20fc0-5cdb8d9966-ks9fz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f20fc0-89489b479-5h6bb

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-f20fc0-5cdb8d9966-ks9fz

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f20fc0-5cdb8d9966-ks9fz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f20fc0-89489b479-5h6bb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f20fc0-89489b479-5h6bb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f20fc0-89489b479-5h6bb

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0a2237-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0a2237-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f20fc0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7240-131870

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f20fc0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

test-curl-7240-131870

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7240-131870

Created

Container created

opendatahub

kubelet

test-curl-7240-131870

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.973s (2.973s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7240-131870

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ad865c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0a2237-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0a2237-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ad865c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0a2237-867f7ff655-k2kck

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a2237-85f764d744-xn9t7

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-9cvzn

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-9cvzn

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-t8m7q

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cnppr

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cnppr

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

ProbeError

Readiness probe error: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

Unhealthy

Readiness probe failed: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-t8m7q

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

test-curl-7240-131870

Killing

Stopping container test-curl-7240-131870

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cc7720-7464f494bc-rjzsz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-cc7720-658f6844c8-kdz97

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

Unhealthy

Readiness probe failed: Get "http://10.132.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-0a2237-openshift-default-c9b5bf779-88plk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

ProbeError

Readiness probe error: Get "http://10.132.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cc7720-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cc7720-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ad865c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

Started

Container started

openshift-ingress

kubelet

e2e-api-a-cc7720-openshift-default-564f96dcc7-ps6fn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ad865c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-sqjsj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-dfd6g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ad865c-67b7f75bdb-vwdkv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ad865c-6f4fbc9955-nbncx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f20fc0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f20fc0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-f20fc0-5cdb8d9966-ks9fz

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f20fc0-89489b479-5h6bb

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-ad865c-openshift-default-6585d5cdd9-cgpdb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-f20fc0-openshift-default-5b67979f5c-5zlrd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-c5b820

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c5b820

openshift-ingress

replicaset-controller

e2e-api-a-c5b820-openshift-default-6c8f597f85

SuccessfulCreate

Created pod: e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

openshift-ingress

deployment-controller

e2e-api-a-c5b820-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c5b820-openshift-default-6c8f597f85 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-bk7cc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d8d238bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d8d238bf-575d65cbff from 0 to 1

openshift-ingress

multus

e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d8d238bf-85c6b5bff4

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d8d238bf-85c6b5bff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d8d238bf: serviceaccount "payload-processing-e2e-mt-d8d238bf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d8d238bf-85c6b5bff4

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d8d238bf-85c6b5bff4-t48bh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d8d238bf: serviceaccount "payload-processing-e2e-mt-d8d238bf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d8d238bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d8d238bf-85c6b5bff4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-t48bh

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-t48bh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-bk7cc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-bk7cc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-t48bh

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-bk7cc

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-bk7cc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-t48bh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c5b820-57f67f9dcd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c5b820-57f67f9dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c5b820: serviceaccount "payload-processing-e2e-api-a-c5b820" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c5b820

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c5b820-57f67f9dcd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c5b820-57f67f9dcd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c5b820-57f67f9dcd-dpfvh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c5b820

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c5b820: serviceaccount "payload-processing-e2e-api-a-c5b820" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-v5hs6

openshift-ingress

multus

payload-processing-e2e-api-a-c5b820-57f67f9dcd-dpfvh

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5b820-57f67f9dcd-dpfvh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5b820-57f67f9dcd-dpfvh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-v5hs6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-v5hs6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-v5hs6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5b820-57f67f9dcd-dpfvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-v5hs6

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6cd7f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6cd7f4

openshift-ingress

replicaset-controller

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf

SuccessfulCreate

Created pod: e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-389e6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-389e6d

openshift-ingress

replicaset-controller

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99

SuccessfulCreate

Created pod: e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

openshift-ingress

deployment-controller

e2e-ipp-a-389e6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-389e6d-openshift-default-799f7cdcdf from 0 to 1

openshift-ingress

deployment-controller

e2e-ipp-a-6cd7f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-tgdg9

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-389e6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-389e6d-777d766cf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-389e6d-777d766cf8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-389e6d-777d766cf8-cwbm6

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-tgdg9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-389e6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-389e6d-777d766cf8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-389e6d-777d766cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-389e6d: serviceaccount "payload-processing-e2e-ipp-a-389e6d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-389e6d: serviceaccount "payload-processing-e2e-ipp-a-389e6d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-tgdg9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6cd7f4-9f64f859b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6cd7f4: serviceaccount "payload-processing-e2e-ipp-a-6cd7f4" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-777d766cf8-cwbm6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-tgdg9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-tgdg9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-389e6d-777d766cf8-cwbm6

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-777d766cf8-cwbm6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-777d766cf8-cwbm6

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6cd7f4-9f64f859b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-5mwmd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6cd7f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6cd7f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6cd7f4-9f64f859b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-s6rgb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6cd7f4: serviceaccount "payload-processing-e2e-ipp-a-6cd7f4" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-s6rgb

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-5mwmd

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-s6rgb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-s6rgb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-5mwmd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-s6rgb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-5mwmd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-5mwmd

Created

Container created

opendatahub

multus

test-curl-7240-607ad6

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7240-607ad6

Started

Container started

opendatahub

kubelet

test-curl-7240-607ad6

Created

Container created

opendatahub

kubelet

test-curl-7240-607ad6

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-b-b0f9d6-openshift-default-58c6f44bf

SuccessfulCreate

Created pod: e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c5b820-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-b-b0f9d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b0f9d6

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c5b820-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-api-b-b0f9d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b0f9d6-openshift-default-58c6f44bf from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

Created

Container created

openshift-ingress

multus

e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7240-607ad6

Killing

Stopping container test-curl-7240-607ad6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b0f9d6-7bb8df46d6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b0f9d6: serviceaccount "payload-processing-e2e-api-b-b0f9d6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b0f9d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b0f9d6-7bb8df46d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b0f9d6-7bb8df46d6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-gp5ph

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b0f9d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-qh7ds
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b0f9d6: serviceaccount "payload-processing-e2e-api-b-b0f9d6" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-qh7ds

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-gp5ph

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-qh7ds

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-gp5ph

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-qh7ds

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-gp5ph

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-gp5ph

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-qh7ds

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-76698b8d7-tgdg9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-777d766cf8-cwbm6

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-b34f6c-openshift-default-595cd9f785

SuccessfulCreate

Created pod: e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

openshift-ingress

deployment-controller

e2e-api-a-b34f6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b34f6c-openshift-default-595cd9f785 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-b34f6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b34f6c

openshift-ingress

multus

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-9f64f859b-5mwmd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-7969c4c6bc-s6rgb

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-389e6d-57dbc5b744

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-389e6d-57dbc5b744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-389e6d: serviceaccount "payload-processing-e2e-ipp-a-389e6d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-389e6d-57dbc5b744

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-389e6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-389e6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-389e6d-57dbc5b744 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-389e6d: serviceaccount "payload-processing-e2e-ipp-a-389e6d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6cd7f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6cd7f4: serviceaccount "payload-processing-e2e-ipp-a-6cd7f4" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b34f6c-78755bfcb6

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b34f6c-78755bfcb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b34f6c: serviceaccount "payload-processing-e2e-api-a-b34f6c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b34f6c-78755bfcb6

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b34f6c-78755bfcb6-q4txb

openshift-ingress

multus

payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b34f6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b34f6c-78755bfcb6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b34f6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-trbdq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b34f6c: serviceaccount "payload-processing-e2e-api-a-b34f6c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6cd7f4: serviceaccount "payload-processing-e2e-ipp-a-6cd7f4" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-trbdq

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6cd7f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-trbdq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-b34f6c-78755bfcb6-q4txb

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-b34f6c-78755bfcb6-q4txb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-trbdq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-trbdq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-b34f6c-78755bfcb6-q4txb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-b34f6c-78755bfcb6-q4txb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 5.488s (5.488s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.15s (4.15s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 6.201s (6.201s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.474s (4.474s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-9b3619-openshift-default-56bb9797b9

SuccessfulCreate

Created pod: e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

openshift-ingress

replicaset-controller

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9

SuccessfulCreate

Created pod: e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-9b3619

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-9b3619

openshift-ingress

deployment-controller

e2e-ipp-b-9b3619-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-9b3619-openshift-default-56bb9797b9 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-3d1db1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-3d1db1

openshift-ingress

deployment-controller

e2e-ipp-b-3d1db1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-9a6d4b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9a6d4b-openshift-default-6ff4845f87 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-9a6d4b-openshift-default-6ff4845f87

SuccessfulCreate

Created pod: e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

openshift-ingress

gateway_labeler_controller

e2e-api-b-9a6d4b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9a6d4b

openshift-ingress

multus

e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d8d238bf-85c6b5bff4-t48bh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8d238bf-575d65cbff-bk7cc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-389e6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-389e6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6cd7f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6cd7f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c5b820-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c5b820-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3d1db1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3d1db1-96d59b748

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3d1db1-96d59b748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3d1db1: serviceaccount "payload-processing-e2e-ipp-b-3d1db1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3d1db1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3d1db1-96d59b748 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3d1db1: serviceaccount "payload-processing-e2e-ipp-b-3d1db1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3d1db1-96d59b748

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3d1db1-96d59b748-wcl9q

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-rt24t

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-5tzq6

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-rt24t

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-3d1db1-96d59b748-wcl9q

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-rt24t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-rt24t

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9b3619-7f99685759

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-5tzq6

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-5tzq6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3d1db1-96d59b748-wcl9q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-rt24t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-5tzq6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3d1db1-96d59b748-wcl9q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9b3619

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9b3619-749bcdcf58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-5tzq6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3d1db1-96d59b748-wcl9q

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9b3619-7f99685759

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9b3619: serviceaccount "payload-processing-e2e-ipp-b-9b3619" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9b3619-749bcdcf58

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9b3619-749bcdcf58-4zzgj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9b3619-749bcdcf58

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9b3619-749bcdcf58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9b3619: serviceaccount "payload-processing-e2e-ipp-b-9b3619" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9b3619

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9b3619-7f99685759 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9a6d4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9a6d4b-6c567ddb8d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-749bcdcf58-4zzgj

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9a6d4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-lls72
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9a6d4b: serviceaccount "payload-processing-e2e-api-b-9a6d4b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9a6d4b-6c567ddb8d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-s97rd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9a6d4b-6c567ddb8d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9a6d4b: serviceaccount "payload-processing-e2e-api-b-9a6d4b" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-9b3619-749bcdcf58-4zzgj

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-749bcdcf58-4zzgj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-749bcdcf58-4zzgj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-s97rd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-lls72

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-lls72

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-s97rd

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-s97rd

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-s97rd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-lls72

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-lls72

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5b820-57f67f9dcd-dpfvh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5b820-6ff5f8944c-v5hs6

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-389e6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-389e6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6cd7f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6cd7f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b0f9d6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b0f9d6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-6a7dc9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7

SuccessfulCreate

Created pod: e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

openshift-ingress

gateway_labeler_controller

e2e-api-a-6a7dc9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-6a7dc9

openshift-ingress

multus

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-d8d238bf-openshift-default-6d47dc76f7-68zn2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-ttrz9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6a7dc9: serviceaccount "payload-processing-e2e-api-a-6a7dc9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-rdxgr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-6a7dc9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6a7dc9: serviceaccount "payload-processing-e2e-api-a-6a7dc9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-6a7dc9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-rdxgr

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-ttrz9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-ttrz9

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-ttrz9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-rdxgr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-rdxgr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-ttrz9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-rdxgr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9b3619-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9b3619-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b34f6c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-c5b820-openshift-default-6c8f597f85-5zvzr

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b34f6c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9a6d4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9a6d4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b0f9d6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b0f9d6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-59b8fdc4ff-rt24t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3d1db1-96d59b748-wcl9q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9b3619-7f99685759-5tzq6

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-b-9b3619

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-b-9b3619: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-b-9b3619": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-b-9b3619, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 84b845c9-7cfa-4d4b-9940-36a560203571, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-749bcdcf58-4zzgj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b0f9d6-7bb8df46d6-gp5ph

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b0f9d6-84b757d4c9-qh7ds

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3d1db1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3d1db1: serviceaccount "payload-processing-e2e-ipp-b-3d1db1" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3d1db1: serviceaccount "payload-processing-e2e-ipp-b-3d1db1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-kkqq7

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3d1db1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3d1db1-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5

openshift-ingress

deployment-controller

e2e-ipp-b-3d1db1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9 from 1 to 3

openshift-ingress

replicaset-controller

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9

SuccessfulCreate

Created pod: e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

openshift-ingress

replicaset-controller

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9

SuccessfulCreate

Created pod: e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

openshift-ingress

kubelet

payload-processing-e2e-api-a-b34f6c-78755bfcb6-q4txb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b34f6c-5f9ff8598c-trbdq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

Started

Container started

openshift-ingress

multus

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b34f6c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b34f6c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-kkqq7

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-kkqq7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-kkqq7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-kkqq7

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9b3619: serviceaccount "payload-processing-e2e-ipp-b-9b3619" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-ss9pl

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9b3619-57786cf4cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9b3619-57786cf4cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9b3619-57786cf4cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9b3619: serviceaccount "payload-processing-e2e-ipp-b-9b3619" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9b3619

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9b3619-57786cf4cb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9b3619

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-ss9pl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b0f9d6-openshift-default-58c6f44bf-9zqkk

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-ss9pl

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-ss9pl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-ss9pl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3b6e2b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3b6e2b

openshift-ingress

deployment-controller

e2e-ipp-a-3b6e2b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3b6e2b-openshift-default-b66f9754c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c

SuccessfulCreate

Created pod: e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

openshift-ingress

multus

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 5.624s (5.624s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

Unhealthy

Startup probe failed: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.365s (4.365s including waiting). Image size: 166620835 bytes.
(x6)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

ProbeError

Startup probe error: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-b34f6c-openshift-default-595cd9f785-55l48

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-2zw4b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3b6e2b: serviceaccount "payload-processing-e2e-ipp-a-3b6e2b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3b6e2b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-24w9z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3b6e2b: serviceaccount "payload-processing-e2e-ipp-a-3b6e2b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3b6e2b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-24w9z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-24w9z

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-24w9z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-24w9z

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-2zw4b

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-2zw4b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-2zw4b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-2zw4b

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3d1db1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3d1db1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9a6d4b-69cd6fcb47-lls72

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9a6d4b-6c567ddb8d-s97rd

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-29f633-openshift-default-68b8bcc957

SuccessfulCreate

Created pod: e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9a6d4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-b-29f633-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-29f633-openshift-default-68b8bcc957 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-29f633

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-29f633
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9a6d4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-29f633

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-29f633-fb468b56b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-29f633-fb468b56b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-29f633-fb468b56b-ns5qk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-29f633-fb468b56b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-29f633-fb468b56b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-29f633: serviceaccount "payload-processing-e2e-api-b-29f633" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-29f633-6f8fb58955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-29f633-6f8fb58955-x6jlg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-29f633

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-29f633-6f8fb58955 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-29f633-6f8fb58955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-29f633-6f8fb58955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-29f633: serviceaccount "payload-processing-e2e-api-b-29f633" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29f633-6f8fb58955-x6jlg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-29f633-fb468b56b-ns5qk

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-29f633-fb468b56b-ns5qk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-29f633-fb468b56b-ns5qk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29f633-6f8fb58955-x6jlg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29f633-6f8fb58955-x6jlg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-29f633-fb468b56b-ns5qk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-29f633-6f8fb58955-x6jlg

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-7mt5c

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-9a6d4b-openshift-default-6ff4845f87-fqvmr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xhqjl

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-1b1d04

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-1b1d04
(x2)

openshift-ingress

kubelet

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3d1db1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-a-1b1d04-openshift-default-6467df856f

SuccessfulCreate

Created pod: e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3d1db1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-a-1b1d04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-1b1d04-openshift-default-6467df856f from 0 to 1

openshift-ingress

multus

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1b1d04-86f4c75484

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-1b1d04-86f4c75484-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1b1d04: serviceaccount "payload-processing-e2e-praxis-a-1b1d04" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-1b1d04

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-1b1d04-86f4c75484 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-1b1d04

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1b1d04: serviceaccount "payload-processing-e2e-praxis-a-1b1d04" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1b1d04-86f4c75484

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk
(x5)

openshift-ingress

kubelet

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

ProbeError

Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

Unhealthy

Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6a7dc9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6a7dc9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3b6e2b-b9f688cd8-24w9z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3b6e2b-bdb96dccf-2zw4b

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9b3619-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9b3619-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cd7f4-67fb7cfd79-v9sjb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cd7f4-7fbd7d57f4-7lljc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-6cd7f4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-6cd7f4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-6cd7f4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-6cd7f4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6d5a1969-5f76-4374-acd6-56746d882ba9, UID in object meta:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3b6e2b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3b6e2b: serviceaccount "payload-processing-e2e-ipp-a-3b6e2b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3b6e2b: serviceaccount "payload-processing-e2e-ipp-a-3b6e2b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3b6e2b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

ProbeError

Readiness probe error: Get "http://10.134.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-w59hq

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-w59hq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-w59hq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-w59hq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-xl2wz

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-xl2wz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-w59hq

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

Unhealthy

Readiness probe failed: Get "http://10.134.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-xl2wz

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-xl2wz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-xl2wz

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-6cd7f4-openshift-default-84d8d46b99-8cw7h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6a7dc9-666cdfb855-rdxgr

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-6a7dc9-5cc9bf64f4-ttrz9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-29f633-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-29f633-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-389e6d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf

SuccessfulCreate

Created pod: e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

openshift-ingress

deployment-controller

e2e-ipp-a-389e6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-389e6d-openshift-default-799f7cdcdf from 1 to 2

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

Started

Container started

openshift-ingress

multus

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6a7dc9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6a7dc9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9

SuccessfulCreate

Created pod: e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

openshift-ingress

deployment-controller

e2e-praxis-b-f493f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f493f7-openshift-default-f8bdc57b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f493f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f493f7
(x7)

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:

openshift-ingress

multus

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-277dc9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-277dc9

openshift-ingress

deployment-controller

e2e-ipp-b-277dc9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-277dc9-openshift-default-fb6787465 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-277dc9-openshift-default-fb6787465

SuccessfulCreate

Created pod: e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

openshift-ingress

multus

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9b3619-6b776b55dc-ss9pl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-6a7dc9-openshift-default-6dc86bd9c7-756xk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9b3619-57786cf4cb-hgkw7

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f493f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f493f7-79fd656c6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f493f7-79fd656c6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f493f7-79fd656c6-s28fq
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f493f7-79fd656c6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f493f7-79fd656c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f493f7: serviceaccount "payload-processing-e2e-praxis-b-f493f7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f493f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f493f7: serviceaccount "payload-processing-e2e-praxis-b-f493f7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-nk64c

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-277dc9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-277dc9: serviceaccount "payload-processing-e2e-ipp-b-277dc9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-kl2kh

openshift-ingress

multus

payload-processing-e2e-praxis-b-f493f7-79fd656c6-s28fq

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f493f7-79fd656c6-s28fq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-277dc9: serviceaccount "payload-processing-e2e-ipp-b-277dc9" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f493f7-79fd656c6-s28fq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-nk64c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-nk64c

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-277dc9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f493f7-79fd656c6-s28fq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-nk64c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-nk64c

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-7wxj4

openshift-ingress

multus

payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-kl2kh

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-kl2kh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-kl2kh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-7wxj4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-kl2kh

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

ProbeError

Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-7wxj4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-7wxj4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-7wxj4

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

Unhealthy

Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3b6e2b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3b6e2b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulDelete

Deleted pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-92lb7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulDelete

Deleted pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

openshift-ingress

deployment-controller

e2e-praxis-a-3faa07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5

SuccessfulCreate

Created pod: e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-3faa07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-3faa07

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-cvmbx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-29f633-fb468b56b-ns5qk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-9b3619-openshift-default-56bb9797b9-sbjs9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29f633-6f8fb58955-x6jlg

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-t2nx2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5p7dm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 10 to 8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-3faa07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3faa07: serviceaccount "payload-processing-e2e-praxis-a-3faa07" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1d04-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-9746m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3faa07-7c8cbf956

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-3faa07-7c8cbf956-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3faa07: serviceaccount "payload-processing-e2e-praxis-a-3faa07" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3faa07-7c8cbf956

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-3faa07-7c8cbf956-bzf68
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1d04-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-3faa07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-3faa07-7c8cbf956 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3faa07-7c8cbf956-bzf68

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3faa07-7c8cbf956-bzf68

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-9746m

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-3faa07-7c8cbf956-bzf68

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3faa07-7c8cbf956-bzf68

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-9746m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-9746m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-9746m

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-29f633-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-29f633-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3b6e2b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3b6e2b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-rcpkf

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-rcpkf

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rcpkf

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rcpkf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rcpkf

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-277dc9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-277dc9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-29f633-openshift-default-68b8bcc957-7mmqx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-c6092e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c6092e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c6092e

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rcpkf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rcpkf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f

SuccessfulCreate

Created pod: e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1d04-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1d04-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c6092e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c6092e-cf9665854 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c6092e-cf9665854

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c6092e-cf9665854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c6092e: serviceaccount "payload-processing-e2e-ipp-a-c6092e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c6092e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c6092e-cf9665854

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c6092e-cf9665854-xjmhw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-jdmzx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c6092e: serviceaccount "payload-processing-e2e-ipp-a-c6092e" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6092e-cf9665854-xjmhw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6092e-cf9665854-xjmhw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-jdmzx

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-jdmzx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-jdmzx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-jdmzx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6092e-cf9665854-xjmhw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-c6092e-cf9665854-xjmhw

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-277dc9-9d5658d5f-7wxj4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-277dc9-59bfb9d7f8-kl2kh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulDelete

Deleted pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-l2rds

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulDelete

Deleted pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-978qc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-7xb9w
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-277dc9-b8848778d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-277dc9-b8848778d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-277dc9: serviceaccount "payload-processing-e2e-ipp-b-277dc9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-277dc9-b8848778d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-277dc9-b8848778d-2kslm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-277dc9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-277dc9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-277dc9-b8848778d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-277dc9: serviceaccount "payload-processing-e2e-ipp-b-277dc9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-7xb9w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-7xb9w

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-7xb9w

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-277dc9-b8848778d-2kslm

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-277dc9-b8848778d-2kslm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-277dc9-b8848778d-2kslm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-277dc9-b8848778d-2kslm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-7xb9w

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 10 to 8

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-z9xmv

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-599xr

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-5cf30a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-5cf30a

openshift-ingress

kubelet

e2e-praxis-b-5cf30a-openshift-default-64bb6488b5-999mz

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-b-5cf30a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-5cf30a-openshift-default-64bb6488b5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-5cf30a-openshift-default-64bb6488b5-999mz

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-5cf30a-openshift-default-64bb6488b5-999mz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-5cf30a-openshift-default-64bb6488b5-999mz

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-b-5cf30a-openshift-default-64bb6488b5

SuccessfulCreate

Created pod: e2e-praxis-b-5cf30a-openshift-default-64bb6488b5-999mz

openshift-ingress

kubelet

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

ProbeError

Readiness probe error: Get "http://10.132.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6092e-5545cf6799-jdmzx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

Unhealthy

Readiness probe failed: Get "http://10.132.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6092e-cf9665854-xjmhw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

ProbeError

Readiness probe error: Get "http://10.132.0.156:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

Unhealthy

Readiness probe failed: Get "http://10.132.0.156:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-5cf30a: serviceaccount "payload-processing-e2e-praxis-b-5cf30a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-47jq6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-5cf30a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

ProbeError

Readiness probe error: Get "http://10.132.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-5cf30a: serviceaccount "payload-processing-e2e-praxis-b-5cf30a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-5cf30a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

Unhealthy

Readiness probe failed: Get "http://10.132.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-47jq6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-47jq6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-47jq6

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-47jq6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c6092e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c6092e-548467b6bd from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3faa07-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c6092e-548467b6bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c6092e-548467b6bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c6092e: serviceaccount "payload-processing-e2e-ipp-a-c6092e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c6092e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-kqh55
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c6092e: serviceaccount "payload-processing-e2e-ipp-a-c6092e" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3faa07-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c6092e-548467b6bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c6092e-548467b6bd-7gkz2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-kqh55

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-kqh55

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-kqh55

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-c6092e-548467b6bd-7gkz2

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f493f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f493f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-kqh55

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

ProbeError

Startup probe error: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

Unhealthy

Startup probe failed: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

Unhealthy

Startup probe failed: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

ProbeError

Startup probe error: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6092e-548467b6bd-7gkz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6092e-548467b6bd-7gkz2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6092e-548467b6bd-7gkz2

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-a-1b1d04-openshift-default-6467df856f

SuccessfulCreate

Created pod: e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1d04-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-1b1d04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-1b1d04-openshift-default-6467df856f from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3b6e2b-5f74cbdd58-xl2wz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

Started

Container started

openshift-ingress

multus

e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3b6e2b-df8756bc9-w59hq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-3b6e2b-openshift-default-b66f9754c-2d4jq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8b3020

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8b3020

openshift-ingress

deployment-controller

e2e-ipp-b-8b3020-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8b3020-openshift-default-597ff96f5 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3faa07-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3faa07-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-b-8b3020-openshift-default-597ff96f5

SuccessfulCreate

Created pod: e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f493f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5cf30a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5cf30a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f493f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c6092e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c6092e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8b3020

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8b3020-778c785455 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8b3020

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-v7mcz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b3020-778c785455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8b3020-778c785455-7pqb2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b3020: serviceaccount "payload-processing-e2e-ipp-b-8b3020" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b3020-778c785455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8b3020-778c785455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b3020: serviceaccount "payload-processing-e2e-ipp-b-8b3020" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b3020-778c785455-7pqb2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-v7mcz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b3020-778c785455-7pqb2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-v7mcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-v7mcz

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b3020-778c785455-7pqb2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8b3020-778c785455-7pqb2

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-v7mcz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-277dc9-b8848778d-2kslm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-277dc9-65b9775fc5-7xb9w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3faa07-5c8c8448bc-9746m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3faa07-7c8cbf956-bzf68

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-277dc9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-277dc9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c6092e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c6092e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-277dc9-openshift-default-fb6787465-ljpkz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3faa07-openshift-default-6f98bf9cd5-x9bd8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-389e6d-86f8b7cc75-rstzt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-389e6d-57dbc5b744-jj7g8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b3020-778c785455-7pqb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b3020-6cdd4cb6f6-v7mcz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b3020-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b3020-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5cf30a-685bdb4b4c-47jq6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-btcln

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-389e6d-openshift-default-799f7cdcdf-lj8xr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5cf30a-95c8ff4c8-7hjcf

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.145:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8b3020

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8b3020

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8b3020-7477b6db4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-wpmx4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b3020: serviceaccount "payload-processing-e2e-ipp-b-8b3020" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b3020-7477b6db4b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8b3020-7477b6db4b-rphdv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b3020-7477b6db4b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8b3020-7477b6db4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b3020: serviceaccount "payload-processing-e2e-ipp-b-8b3020" not found

openshift-ingress

kubelet

e2e-praxis-b-5cf30a-openshift-default-64bb6488b5-999mz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b3020-7477b6db4b-rphdv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-wpmx4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-wpmx4

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b3020-7477b6db4b-rphdv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-8b3020-7477b6db4b-rphdv

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b3020-7477b6db4b-rphdv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-wpmx4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-wpmx4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3d1db1-57776c5455-htkh5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3d1db1-7d9b8cc5c8-kkqq7

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

Unhealthy

Startup probe failed: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

ProbeError

Startup probe error: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-pv6zh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-86crj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

ProbeError

Readiness probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3d1db1-openshift-default-f56dcd7f9-mq6jz

Unhealthy

Readiness probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-c6092e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-c6092e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-c6092e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-c6092e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8f5ff31d-3a5c-421b-a443-062a38f89151, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6092e-548467b6bd-7gkz2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6092e-74cbff7f67-kqh55

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b3020-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b3020-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulCreate

Created pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

Created

Container created

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-c6092e-openshift-default-6d8ccdf74f-vtnkz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

Unhealthy

Readiness probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

ProbeError

Readiness probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 8 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x10)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

Created

Container created

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b3020-7477b6db4b-rphdv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b3020-8445c77dc-wpmx4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-txmdk

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

Unhealthy

Startup probe failed: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

ProbeError

Startup probe error: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-1b1d04-openshift-default-6467df856f-mhprq

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1d04-86f4c75484-c5fgk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-ipp-b-8b3020-openshift-default-597ff96f5-qfw9x

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1d04-5d49fb46ff-xtnb2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-8fa615

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-8fa615

openshift-ingress

replicaset-controller

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7

SuccessfulCreate

Created pod: e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

openshift-ingress

deployment-controller

e2e-praxis-a-8fa615-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 8 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

Started

Container started

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f493f7-8bb6b74c-nk64c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f493f7-79fd656c6-s28fq

Killing

Stopping container payload-processing
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Unhealthy

Liveness probe failed: Get "https://10.132.0.51:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-8fa615

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8fa615: serviceaccount "payload-processing-e2e-praxis-a-8fa615" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-rgqgd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-8fa615

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-45cts
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8fa615: serviceaccount "payload-processing-e2e-praxis-a-8fa615" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-45cts

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-45cts

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-rgqgd

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-rgqgd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x10)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-45cts

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-f493f7-openshift-default-f8bdc57b9-bwd5s

Killing

Stopping container istio-proxy
(x10)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-45cts

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-rgqgd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-rgqgd

Created

Container created
(x11)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

ProbeError

Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

Unhealthy

Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ktjlp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-855f9574cf-9cvzn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-9cvzn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-855f9574cf from 10 to 9

openshift-ingress

replicaset-controller

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5

SuccessfulCreate

Created pod: e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-c131fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-c131fa

openshift-ingress

deployment-controller

e2e-praxis-b-c131fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c131fa-576cccf4c6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-c131fa-576cccf4c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c131fa: serviceaccount "payload-processing-e2e-praxis-b-c131fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c131fa-576cccf4c6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-c131fa-576cccf4c6-7tr7h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-c131fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c131fa: serviceaccount "payload-processing-e2e-praxis-b-c131fa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-c131fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-c131fa-576cccf4c6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-7xk9l

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-7xk9l

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c131fa-576cccf4c6-7tr7h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c131fa-576cccf4c6-7tr7h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-c131fa-576cccf4c6-7tr7h

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c131fa-576cccf4c6-7tr7h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-7xk9l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-7xk9l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-7xk9l

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-855f9574cf-cnppr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cnppr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-855f9574cf from 9 to 8
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

Unhealthy

Readiness probe failed: Get "http://10.132.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

ProbeError

Readiness probe error: Get "http://10.132.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8fa615-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8fa615-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8fa615-54b7cc8fb6-rgqgd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8fa615-54c4d8547f-45cts

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-942930

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-942930

openshift-ingress

replicaset-controller

e2e-shared-a-w4-942930-openshift-default-548c4f9d89

SuccessfulCreate

Created pod: e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

openshift-ingress

deployment-controller

e2e-shared-a-w4-942930-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-942930-openshift-default-548c4f9d89 from 0 to 1
(x11)

openshift-ingress

kubelet

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

Unhealthy

Startup probe failed: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

ProbeError

Startup probe error: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w0-4fb1d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f

SuccessfulCreate

Created pod: e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-4fb1d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-4fb1d0

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-942930

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-wmdcf
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8fa615-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8fa615-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-942930-674dbf8f98

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-942930-674dbf8f98-5tmhl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-942930: serviceaccount "payload-processing-e2e-shared-a-w4-942930" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-942930

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-942930-674dbf8f98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-942930-674dbf8f98

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-942930-674dbf8f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-942930: serviceaccount "payload-processing-e2e-shared-a-w4-942930" not found

openshift-ingress

multus

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-wmdcf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-942930-674dbf8f98-5tmhl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-942930-674dbf8f98-5tmhl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-wmdcf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-942930-674dbf8f98-5tmhl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-942930-674dbf8f98-5tmhl

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-wmdcf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-wmdcf

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-bk5wq

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulDelete

Deleted pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-6vlsr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 8 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-4fb1d0: serviceaccount "payload-processing-e2e-shared-a-w0-4fb1d0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-4fb1d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-4fb1d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-b8pcg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-cs7sz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-4fb1d0: serviceaccount "payload-processing-e2e-shared-a-w0-4fb1d0" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-b8pcg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-cs7sz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-b8pcg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-b8pcg

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-cs7sz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-b8pcg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-cs7sz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-cs7sz

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

Unhealthy

Startup probe failed: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

ProbeError

Startup probe error: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

Created

Container created

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

Created

Container created

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-8fa615-openshift-default-5b9bd9b8f7-mfght

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

ProbeError

Readiness probe error: Get "http://10.134.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-bfc240

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-bfc240

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

Unhealthy

Readiness probe failed: Get "http://10.134.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-a-w3-bfc240-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-bfc240-openshift-default-857dd6696c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c

SuccessfulCreate

Created pod: e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-c2fbm

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-a-w1-f154ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc from 0 to 1

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-fxm7k

Unhealthy

Readiness probe failed: Get "https://10.134.0.35:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc

SuccessfulCreate

Created pod: e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-f154ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-f154ac

openshift-ingress

multus

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c131fa-59c6c6877f-7xk9l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c131fa-576cccf4c6-7tr7h

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulDelete

Deleted pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs
(x9)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gvdgs

Killing

Stopping container istio-proxy
(x9)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

Unhealthy

Startup probe failed: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

ProbeError

Startup probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

ProbeError

Startup probe error: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

Unhealthy

Startup probe failed: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

Unhealthy

Startup probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

ProbeError

Startup probe error: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c131fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c131fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

Unhealthy

Startup probe failed: Get "http://10.134.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

ProbeError

Startup probe error: Get "http://10.134.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-bfc240-76778fd956

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-bfc240-76778fd956-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-bfc240: serviceaccount "payload-processing-e2e-shared-a-w3-bfc240" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-bfc240

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-bfc240

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-bfc240-76778fd956 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-bfc240-76778fd956

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-bfc240-76778fd956-68nbp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-bfc240: serviceaccount "payload-processing-e2e-shared-a-w3-bfc240" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-hsr2v

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-f154ac-6d9544787d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-zr84z

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-bfc240-76778fd956-68nbp

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-hsr2v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-hsr2v

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-f154ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-7clrt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-f154ac: serviceaccount "payload-processing-e2e-shared-a-w1-f154ac" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-hsr2v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bfc240-76778fd956-68nbp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bfc240-76778fd956-68nbp

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-942930-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-f154ac-6d9544787d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-f154ac: serviceaccount "payload-processing-e2e-shared-a-w1-f154ac" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bfc240-76778fd956-68nbp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-hsr2v

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-f154ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-f154ac-6d9544787d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-zr84z

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-7clrt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-7clrt

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-7clrt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-7clrt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-zr84z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-zr84z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-zr84z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-81a5ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-81a5ae

openshift-ingress

replicaset-controller

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59

SuccessfulCreate

Created pod: e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

openshift-ingress

deployment-controller

e2e-shared-b-w0-81a5ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59 from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-c131fa-openshift-default-5b9cdbc9d5-sjwtw

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-nqjxm

openshift-ingress

multus

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-88a18e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-88a18e

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-81a5ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w4-88a18e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-88a18e-openshift-default-7687cc86c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c

SuccessfulCreate

Created pod: e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-gtfbc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-81a5ae: serviceaccount "payload-processing-e2e-shared-b-w0-81a5ae" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-81a5ae: serviceaccount "payload-processing-e2e-shared-b-w0-81a5ae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-81a5ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-nqjxm

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

Unhealthy

Readiness probe failed: Get "http://10.134.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-nqjxm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-gtfbc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-gtfbc

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

ProbeError

Readiness probe error: Get "http://10.134.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-gtfbc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-gtfbc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-nqjxm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-nqjxm

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-2nmsp

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-88a18e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-88a18e-88bc6576 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-88a18e-88bc6576

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-88a18e-88bc6576-zdcn4

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-88a18e-88bc6576-zdcn4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-2nmsp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-88a18e: serviceaccount "payload-processing-e2e-shared-b-w4-88a18e" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-2nmsp

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-88a18e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-88a18e-88bc6576-zdcn4

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-88a18e-88bc6576

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-88a18e-88bc6576-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-88a18e: serviceaccount "payload-processing-e2e-shared-b-w4-88a18e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-2nmsp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-88a18e-88bc6576-zdcn4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-88a18e-88bc6576-zdcn4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-2nmsp

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55

SuccessfulCreate

Created pod: e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-bcfde8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-bcfde8

openshift-ingress

deployment-controller

e2e-shared-b-w3-bcfde8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-43c674

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-43c674

openshift-ingress

replicaset-controller

e2e-shared-b-w1-43c674-openshift-default-695d458dd9

SuccessfulCreate

Created pod: e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

openshift-ingress

deployment-controller

e2e-shared-b-w1-43c674-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-43c674-openshift-default-695d458dd9 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

Unhealthy

Readiness probe failed: Get "http://10.134.0.161:15021/healthz/ready": read tcp 10.134.0.2:53878->10.134.0.161:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

ProbeError

Readiness probe error: Get "http://10.134.0.161:15021/healthz/ready": read tcp 10.134.0.2:53878->10.134.0.161:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

Created

Container created

openshift-ingress

multus

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-pbsmc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-bcfde8: serviceaccount "payload-processing-e2e-shared-b-w3-bcfde8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-bcfde8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-bcfde8: serviceaccount "payload-processing-e2e-shared-b-w3-bcfde8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-bxvrr

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-bcfde8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-pbsmc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-bxvrr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-pbsmc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-bxvrr

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-pbsmc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-pbsmc

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-dl2t2

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-bxvrr

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-43c674

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-bxvrr

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-explicit-78d47a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-78d47a
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-43c674-bf97746fd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-43c674-bf97746fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-43c674: serviceaccount "payload-processing-e2e-shared-b-w1-43c674" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-43c674: serviceaccount "payload-processing-e2e-shared-b-w1-43c674" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-43c674-bf97746fd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-43c674-bf97746fd-vzmjm

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-43c674

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-43c674-bf97746fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-43c674-bf97746fd-vzmjm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-dl2t2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-43c674-bf97746fd-vzmjm

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-43c674-bf97746fd-vzmjm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-dl2t2

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-dl2t2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-dl2t2

Created

Container created

openshift-ingress

deployment-controller

e2e-explicit-78d47a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-78d47a-openshift-default-6fd47b5945 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-78d47a-openshift-default-6fd47b5945

SuccessfulCreate

Created pod: e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-43c674-bf97746fd-vzmjm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

Unhealthy

Startup probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

ProbeError

Startup probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4fb1d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4fb1d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-88a18e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-88a18e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-78d47a-568c4fc5dd

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-78d47a-568c4fc5dd-qjxxf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-78d47a-66f8c9595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-78d47a-66f8c9595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-78d47a: serviceaccount "payload-processing-e2e-explicit-78d47a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-78d47a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-78d47a-568c4fc5dd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-78d47a-66f8c9595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-78d47a-66f8c9595-xvsjj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-78d47a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-78d47a-66f8c9595 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-78d47a-568c4fc5dd

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-78d47a-568c4fc5dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-78d47a: serviceaccount "payload-processing-e2e-explicit-78d47a" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-78d47a-66f8c9595-xvsjj

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-78d47a-66f8c9595-xvsjj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-78d47a-66f8c9595-xvsjj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-78d47a-568c4fc5dd-qjxxf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-explicit-78d47a-568c4fc5dd-qjxxf

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-78d47a-66f8c9595-xvsjj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-78d47a-568c4fc5dd-qjxxf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-78d47a-568c4fc5dd-qjxxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c

SuccessfulCreate

Created pod: e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w3-bfc240-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-bfc240-openshift-default-857dd6696c from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bfc240-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c

SuccessfulCreate

Created pod: e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c

SuccessfulCreate

Created pod: e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

openshift-ingress

multus

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rcpkf

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-rcpkf
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

Unhealthy

Startup probe failed: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

ProbeError

Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

Unhealthy

Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

ProbeError

Startup probe error: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4fb1d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4fb1d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bfc240-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bfc240-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-81a5ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-81a5ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-f154ac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-f154ac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

ProbeError

Readiness probe error: Get "http://10.132.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

Unhealthy

Readiness probe failed: Get "http://10.132.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bfc240-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bfc240-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-81a5ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-81a5ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-f154ac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-f154ac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bcfde8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bcfde8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-78d47a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-78d47a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

Unhealthy

Startup probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

ProbeError

Startup probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-88a18e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-88a18e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bcfde8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bcfde8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-78d47a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-78d47a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59

SuccessfulCreate

Created pod: e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

openshift-ingress

deployment-controller

e2e-shared-b-w0-81a5ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-81a5ae-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc

SuccessfulCreate

Created pod: e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

openshift-ingress

multus

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-f154ac-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w1-f154ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-78d47a-568c4fc5dd-qjxxf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-78d47a-66f8c9595-xvsjj

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

Unhealthy

Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

ProbeError

Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

Started

Container started

openshift-ingress

kubelet

e2e-explicit-78d47a-openshift-default-6fd47b5945-7zzww

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-noten-a44263-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-a44263-openshift-default-668c89cc89 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-43c674-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-noten-a44263

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-a44263

openshift-ingress

replicaset-controller

e2e-noten-a44263-openshift-default-668c89cc89

SuccessfulCreate

Created pod: e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-43c674-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

Started

Container started

openshift-ingress

kubelet

e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

Created

Container created

openshift-ingress

kubelet

e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

ProbeError

Startup probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

Unhealthy

Startup probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-t8m7q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-855f9574cf-t8m7q

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulDelete

Deleted pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

openshift-ingress

kubelet

e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-zn989

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-a44263-openshift-default-668c89cc89-vx5cj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-43c674-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-43c674-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7240-01af22

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7240-01af22

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7240-01af22

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 899ms (899ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7240-01af22

Started

Container started

opendatahub

kubelet

test-curl-7240-01af22

Created

Container created

opendatahub

kubelet

test-curl-7240-01af22

Killing

Stopping container test-curl-7240-01af22

openshift-ingress

deployment-controller

e2e-shared-a-w2-836265-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-836265-openshift-default-67b9f59555 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-836265

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-836265

openshift-ingress

replicaset-controller

e2e-shared-a-w2-836265-openshift-default-67b9f59555

SuccessfulCreate

Created pod: e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

openshift-ingress

multus

e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-836265

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-836265: serviceaccount "payload-processing-e2e-shared-a-w2-836265" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-836265: serviceaccount "payload-processing-e2e-shared-a-w2-836265" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-836265

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-660d95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-660d95

openshift-ingress

deployment-controller

e2e-shared-b-w2-660d95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-660d95-openshift-default-66c7467465 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulCreate

Created pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

openshift-ingress

multus

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-660d95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-660d95-8474b9648b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-660d95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-660d95: serviceaccount "payload-processing-e2e-shared-b-w2-660d95" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-660d95-8474b9648b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-660d95-8474b9648b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-660d95-8474b9648b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-660d95: serviceaccount "payload-processing-e2e-shared-b-w2-660d95" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulDelete

Deleted pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-wsnrj

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

opendatahub

kubelet

test-curl-7240-e41344

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7240-e41344

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7240-e41344

Started

Container started

opendatahub

kubelet

test-curl-7240-e41344

Created

Container created

opendatahub

kubelet

test-curl-7240-e41344

Killing

Stopping container test-curl-7240-e41344

opendatahub

kubelet

test-curl-7240-ae2e10

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7240-ae2e10

Created

Container created

opendatahub

multus

test-curl-7240-ae2e10

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7240-ae2e10

Started

Container started

opendatahub

kubelet

test-curl-7240-160ed4

Started

Container started

opendatahub

kubelet

test-curl-7240-160ed4

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7240-ae2e10

Killing

Stopping container test-curl-7240-ae2e10

opendatahub

kubelet

test-curl-7240-160ed4

Created

Container created

opendatahub

multus

test-curl-7240-160ed4

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7240-875e8a

Started

Container started

opendatahub

kubelet

test-curl-7240-875e8a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7240-875e8a

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7240-875e8a

Created

Container created

opendatahub

kubelet

test-curl-7240-160ed4

Killing

Stopping container test-curl-7240-160ed4

opendatahub

kubelet

test-curl-7240-875e8a

Killing

Stopping container test-curl-7240-875e8a
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-836265-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-836265-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 9 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulDelete

Deleted pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-7kx47

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-eb69cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-eb69cb

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-eb69cb: serviceaccount "payload-processing-e2e-extmod-a-eb69cb" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulCreate

Created pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-eb69cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-eb69cb-578f87d45d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-eb69cb-578f87d45d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-eb69cb-578f87d45d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-eb69cb: serviceaccount "payload-processing-e2e-extmod-a-eb69cb" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulCreate

Created pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

openshift-ingress

deployment-controller

e2e-shared-b-w2-660d95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-660d95-openshift-default-66c7467465 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-eb69cb-578f87d45d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-eb69cb-578f87d45d-slgsc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-eb69cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulCreate

Created pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd

Created

Container created

openshift-ingress

multus

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

Created

Container created

openshift-ingress

multus

e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

Started

Container started

openshift-ingress

multus

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-eb69cb-578f87d45d-slgsc

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-eb69cb-578f87d45d-slgsc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-eb69cb-578f87d45d-slgsc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-eb69cb-578f87d45d-slgsc

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

Unhealthy

Readiness probe failed: Get "http://10.132.0.220:15021/healthz/ready": read tcp 10.132.0.2:52978->10.132.0.220:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

ProbeError

Readiness probe error: Get "http://10.132.0.220:15021/healthz/ready": read tcp 10.132.0.2:52978->10.132.0.220:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

Unhealthy

Startup probe failed: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

Unhealthy

Startup probe failed: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

ProbeError

Startup probe error: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

ProbeError

Startup probe error: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

Unhealthy

Startup probe failed: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

ProbeError

Startup probe error: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-a0d4ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a0d4ec

openshift-ingress

replicaset-controller

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9

SuccessfulCreate

Created pod: e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

openshift-ingress

deployment-controller

e2e-extmod-a-a0d4ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulDelete

Deleted pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 8 to 7

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-2djvm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 10 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7237-99891e

Created

Container created

opendatahub

kubelet

test-curl-7237-99891e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-6xjzh

opendatahub

multus

test-curl-7237-99891e

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7237-99891e

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-rs6nc

opendatahub

kubelet

test-curl-7237-99891e

Killing

Stopping container test-curl-7237-99891e

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-lm9zq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-855f9574cf-lm9zq
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-7x6cg

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

test-curl-7243-385b32

Started

Container started

opendatahub

kubelet

test-curl-7243-385b32

Created

Container created

opendatahub

kubelet

test-curl-7243-385b32

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7243-385b32

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-a0d4ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699 from 0 to 1

opendatahub

kubelet

test-curl-7243-385b32

Killing

Stopping container test-curl-7243-385b32

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-a0d4ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-a0d4ec-576fcc686 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a0d4ec: serviceaccount "payload-processing-e2e-extmod-a-a0d4ec" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a0d4ec-576fcc686

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-a0d4ec-576fcc686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a0d4ec: serviceaccount "payload-processing-e2e-extmod-a-a0d4ec" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a0d4ec-576fcc686

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-8b7351

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-8b7351

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w4-88a18e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-88a18e-openshift-default-7687cc86c from 1 to 2

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-88a18e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c

SuccessfulCreate

Created pod: e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

openshift-ingress

multus

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulCreate

Created pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-8b7351-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-8b7351-openshift-default-54db9b4bf7 from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

Started

Container started

openshift-ingress

multus

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-8b7351

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-8b7351

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-8b7351-5fc98886d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8b7351: serviceaccount "payload-processing-e2e-extmod-a-8b7351" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8b7351-5fc98886d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-8b7351-5fc98886d-twv27
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8b7351-5fc98886d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-8b7351-5fc98886d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8b7351: serviceaccount "payload-processing-e2e-extmod-a-8b7351" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8b7351-5fc98886d-twv27

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8b7351-5fc98886d-twv27

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8b7351-5fc98886d-twv27

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-8b7351-5fc98886d-twv27

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-46a6d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-46a6d7

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w1-43c674-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-43c674-openshift-default-695d458dd9 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-43c674-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w1-43c674-openshift-default-695d458dd9

SuccessfulCreate

Created pod: e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

openshift-ingress

multus

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-xk5kb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 10 to 9

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulCreate

Created pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

openshift-ingress

deployment-controller

e2e-shared-b-w2-660d95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-660d95-openshift-default-66c7467465 from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-46a6d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-46a6d7-fbf745886 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-46a6d7-fbf745886

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-46a6d7-fbf745886-grqvg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-46a6d7-fbf745886

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-46a6d7-fbf745886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-46a6d7: serviceaccount "payload-processing-e2e-extmod-b-46a6d7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-46a6d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-sl229
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-46a6d7: serviceaccount "payload-processing-e2e-extmod-b-46a6d7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-sl229

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-46a6d7-fbf745886-grqvg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 10 to 8

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-sl229

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-46a6d7-fbf745886-grqvg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-46a6d7-fbf745886-grqvg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-sl229

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-46a6d7-fbf745886-grqvg

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-ndt4p

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-sl229

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-vfd7l
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

ProbeError

Startup probe error: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

Unhealthy

Startup probe failed: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-a-98529d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-98529d-openshift-default-5bd85f96bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-98529d-openshift-default-5bd85f96bf

SuccessfulCreate

Created pod: e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

openshift-ingress

deployment-controller

e2e-autores-36556d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-36556d-openshift-default-658cbc6465 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-36556d-openshift-default-658cbc6465

SuccessfulCreate

Created pod: e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-98529d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-98529d

openshift-ingress

gateway_labeler_controller

e2e-autores-36556d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-36556d

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulDelete

Deleted pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-gkr78

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-kdqmv

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

(combined from similar events): New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-n7pn2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-98529d-5857fc5786

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-dxgp7

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-98529d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-98529d-5857fc5786 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-98529d-5857fc5786

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-98529d-5857fc5786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-98529d: serviceaccount "payload-processing-e2e-extmod-a-98529d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-98529d: serviceaccount "payload-processing-e2e-extmod-a-98529d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-98529d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-36556d-58f7c56d79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-36556d-58f7c56d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-36556d: serviceaccount "payload-processing-e2e-autores-36556d" not found

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-dxgp7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-dxgp7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-dxgp7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-dxgp7

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulDelete

Deleted pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-s4255

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-36556d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-36556d-58f7c56d79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-36556d-58f7c56d79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-36556d-58f7c56d79-psw9k

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-36556d-f66cd46b

FailedCreate

Error creating: pods "payload-processing-e2e-autores-36556d-f66cd46b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-36556d: serviceaccount "payload-processing-e2e-autores-36556d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-36556d-f66cd46b

SuccessfulCreate

Created pod: payload-processing-e2e-autores-36556d-f66cd46b-fz9td

openshift-ingress

deployment-controller

payload-processing-e2e-autores-36556d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-36556d-f66cd46b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-36556d-58f7c56d79-psw9k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-36556d-f66cd46b-fz9td

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-36556d-58f7c56d79-psw9k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-36556d-58f7c56d79-psw9k

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-36556d-58f7c56d79-psw9k

Created

Container created

openshift-ingress

multus

payload-processing-e2e-autores-36556d-f66cd46b-fz9td

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-36556d-f66cd46b-fz9td

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-36556d-f66cd46b-fz9td

Created

Container created
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 8 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rvv4n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-w5x6h

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0e1546

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0e1546

openshift-ingress

replicaset-controller

e2e-extmod-b-0e1546-openshift-default-657f9d4657

SuccessfulCreate

Created pod: e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

openshift-ingress

deployment-controller

e2e-extmod-b-0e1546-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0e1546-openshift-default-657f9d4657 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-36556d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-36556d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w3-bcfde8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bcfde8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55

SuccessfulCreate

Created pod: e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

Created

Container created

openshift-ingress

multus

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0e1546-84f49b7cd8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-qj9lt
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0e1546

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0e1546-84f49b7cd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0e1546

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0e1546: serviceaccount "payload-processing-e2e-extmod-b-0e1546" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0e1546-84f49b7cd8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0e1546: serviceaccount "payload-processing-e2e-extmod-b-0e1546" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-qj9lt

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-qj9lt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-qj9lt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-qj9lt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

ProbeError

Startup probe error: Get "http://10.132.0.230:15021/healthz/ready": dial tcp 10.132.0.230:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

Unhealthy

Startup probe failed: Get "http://10.132.0.230:15021/healthz/ready": dial tcp 10.132.0.230:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-b-0e4ce7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0e4ce7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0e4ce7

openshift-ingress

replicaset-controller

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f

SuccessfulCreate

Created pod: e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

openshift-ingress

multus

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

AddedInterface

Add eth0 [10.132.0.246/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-f154ac-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc

SuccessfulCreate

Created pod: e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

openshift-ingress

deployment-controller

e2e-shared-a-w1-f154ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc from 2 to 3

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

Started

Container started

openshift-ingress

multus

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0e4ce7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0e4ce7-698bd89b46

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0e4ce7: serviceaccount "payload-processing-e2e-extmod-b-0e4ce7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0e4ce7: serviceaccount "payload-processing-e2e-extmod-b-0e4ce7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0e4ce7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0e4ce7-698bd89b46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0e4ce7-698bd89b46

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-b4vbq

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a0d4ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a0d4ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-b4vbq

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-b4vbq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-b4vbq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-b4vbq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

Unhealthy

Startup probe failed: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

ProbeError

Startup probe error: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-b503a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-b503a8

openshift-ingress

replicaset-controller

e2e-extmod-b-b503a8-openshift-default-69548545d9

SuccessfulCreate

Created pod: e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

openshift-ingress

deployment-controller

e2e-extmod-b-b503a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b503a8-openshift-default-69548545d9 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-36556d-openshift-default-658cbc6465

SuccessfulCreate

Created pod: e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

openshift-ingress

deployment-controller

e2e-autores-36556d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-36556d-openshift-default-658cbc6465 from 1 to 4

openshift-ingress

replicaset-controller

e2e-autores-36556d-openshift-default-658cbc6465

SuccessfulCreate

Created pod: e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

openshift-ingress

replicaset-controller

e2e-autores-36556d-openshift-default-658cbc6465

SuccessfulCreate

Created pod: e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-36556d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

Started

Container started

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

Created

Container created

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

Started

Container started

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

Started

Container started

openshift-ingress

multus

e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

Created

Container created

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 1 to 4

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

Started

Container started

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b503a8-7bf9b44576

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-b503a8-7bf9b44576-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b503a8: serviceaccount "payload-processing-e2e-extmod-b-b503a8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-b503a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b503a8: serviceaccount "payload-processing-e2e-extmod-b-b503a8" not found
(x2)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

Unhealthy

Readiness probe failed: Get "http://10.132.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

ProbeError

Readiness probe error: Get "http://10.132.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp
(x2)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

Unhealthy

Readiness probe failed: Get "http://10.132.0.241:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b503a8-7bf9b44576

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-b503a8-7bf9b44576-cxrst

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-b503a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-b503a8-7bf9b44576 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

ProbeError

Readiness probe error: Get "http://10.132.0.241:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

ProbeError

Readiness probe error: Get "http://10.132.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-extmod-b-b503a8-7bf9b44576-cxrst

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

Unhealthy

Readiness probe failed: Get "http://10.132.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b503a8-7bf9b44576-cxrst

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b503a8-7bf9b44576-cxrst

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b503a8-7bf9b44576-cxrst

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

Unhealthy

Startup probe failed: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

ProbeError

Startup probe error: Get "http://10.134.0.204:15021/healthz/ready": dial tcp 10.134.0.204:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

Unhealthy

Startup probe failed: Get "http://10.134.0.204:15021/healthz/ready": dial tcp 10.134.0.204:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

ProbeError

Startup probe error: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

ProbeError

Startup probe error: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

Unhealthy

Startup probe failed: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

ProbeError

Startup probe error: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

Unhealthy

Startup probe failed: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e4ce7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e4ce7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

ProbeError

Startup probe error: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

Unhealthy

Startup probe failed: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

Unhealthy

Startup probe failed: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

ProbeError

Startup probe error: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

Unhealthy

Startup probe failed: Get "http://10.132.0.241:15021/healthz/ready": dial tcp 10.132.0.241:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

ProbeError

Startup probe error: Get "http://10.132.0.241:15021/healthz/ready": dial tcp 10.132.0.241:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-36556d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e1546-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e1546-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-36556d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

Unhealthy

Startup probe failed: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

ProbeError

Startup probe error: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-autores-36556d-openshift-default-658cbc6465

SuccessfulCreate

Created pod: e2e-autores-36556d-openshift-default-658cbc6465-967xd

openshift-ingress

deployment-controller

e2e-autores-36556d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-36556d-openshift-default-658cbc6465 from 4 to 7
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-98529d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-98529d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-36556d-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-36556d-58f7c56d79-psw9k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-36556d-f66cd46b-fz9td

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-autores-36556d-openshift-default-658cbc6465

SuccessfulCreate

Created pod: e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

openshift-ingress

replicaset-controller

e2e-autores-36556d-openshift-default-658cbc6465

SuccessfulCreate

Created pod: e2e-autores-36556d-openshift-default-658cbc6465-p7qns

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-967xd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-36556d-openshift-default-658cbc6465-967xd

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 4 to 8

openshift-ingress

multus

e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-967xd

Created

Container created

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

Started

Container started

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-967xd

Started

Container started

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

Created

Container created

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

Started

Container started

openshift-ingress

multus

e2e-autores-36556d-openshift-default-658cbc6465-p7qns

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-p7qns

Started

Container started

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-p7qns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-p7qns

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

Unhealthy

Startup probe failed: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-967xd

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-967xd

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

ProbeError

Startup probe error: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

ProbeError

Startup probe error: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

Unhealthy

Startup probe failed: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

ProbeError

Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

Unhealthy

Startup probe failed: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

ProbeError

Startup probe error: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-p7qns

ProbeError

Startup probe error: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-p7qns

Unhealthy

Startup probe failed: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

Unhealthy

Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e1546-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e1546-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

ProbeError

Readiness probe error: Get "http://10.132.0.246:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

Unhealthy

Readiness probe failed: Get "http://10.132.0.246:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

Unhealthy

Startup probe failed: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

ProbeError

Startup probe error: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

ProbeError

Readiness probe error: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

Unhealthy

Readiness probe failed: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-p7qns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-967xd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

Started

Container started

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-5n8rn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-v6sm7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-bzpxr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

Created

Container created

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nmhgk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-36556d-openshift-default-658cbc6465-nlwxd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-33e267-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-33e267-openshift-default-85f8d58cb5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5

SuccessfulCreate

Created pod: e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-33e267

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-33e267

openshift-ingress

multus

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

ProbeError

Startup probe error: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

Unhealthy

Startup probe failed: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-33e267-7fb8df65fb

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-33e267-7fb8df65fb-6ctzd

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-lsm58

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-33e267

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-33e267-7fb8df65fb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-lsm58
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-33e267-7fb8df65fb

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-33e267-7fb8df65fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-33e267: serviceaccount "payload-processing-e2e-extmod-a-33e267" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-33e267: serviceaccount "payload-processing-e2e-extmod-a-33e267" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-lsm58

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-33e267

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-33e267-7fb8df65fb-6ctzd

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-33e267-7fb8df65fb-6ctzd

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-lsm58

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-33e267-7fb8df65fb-6ctzd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b503a8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-33e267-7fb8df65fb-6ctzd

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b503a8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-lsm58

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e4ce7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b503a8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b503a8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e4ce7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-4c2a28

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-4c2a28

openshift-ingress

replicaset-controller

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9

SuccessfulCreate

Created pod: e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

openshift-ingress

deployment-controller

e2e-extmod-b-4c2a28-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9 from 0 to 1
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Unhealthy

Readiness probe failed: Get "https://10.132.0.51:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-4c2a28-86b687fd6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-4c2a28-86b687fd6-z8rqf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-4c2a28

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-4c2a28: serviceaccount "payload-processing-e2e-extmod-b-4c2a28" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-4c2a28

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-4c2a28-86b687fd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-4c2a28-86b687fd6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-4c2a28-86b687fd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-4c2a28: serviceaccount "payload-processing-e2e-extmod-b-4c2a28" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4c2a28-86b687fd6-z8rqf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-4c2a28-86b687fd6-z8rqf

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4c2a28-86b687fd6-z8rqf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4c2a28-86b687fd6-z8rqf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-8b7351-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-8b7351-openshift-default-54db9b4bf7 from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulCreate

Created pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulCreate

Created pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulCreate

Created pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

Started

Container started

openshift-ingress

multus

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

Created

Container created
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-l5g9c
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

Unhealthy

Startup probe failed: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

ProbeError

Startup probe error: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused body:

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f

SuccessfulCreate

Created pod: e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-d7wsq

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e4ce7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-0e4ce7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f from 1 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

Created

Container created

openshift-ingress

multus

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

Unhealthy

Startup probe failed: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

Unhealthy

Startup probe failed: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

ProbeError

Startup probe error: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

ProbeError

Startup probe error: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

ProbeError

Startup probe error: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

Unhealthy

Startup probe failed: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e1546-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-0e1546-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0e1546-openshift-default-657f9d4657 from 1 to 2
(x8)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

ProbeError

Startup probe error: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

Unhealthy

Startup probe failed: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-0e1546-openshift-default-657f9d4657

SuccessfulCreate

Created pod: e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 8 to 10

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

Created

Container created

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

Started

Container started

openshift-ingress

multus

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

AddedInterface

Add eth0 [10.132.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

Unhealthy

Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

ProbeError

Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-33e267-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-33e267-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4c2a28-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4c2a28-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

ProbeError

Startup probe error: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

Unhealthy

Startup probe failed: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

Unhealthy

Startup probe failed: Get "http://10.132.1.3:15021/healthz/ready": dial tcp 10.132.1.3:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

ProbeError

Startup probe error: Get "http://10.132.1.3:15021/healthz/ready": dial tcp 10.132.1.3:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-660d95-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-660d95-openshift-default-66c7467465 from 5 to 4

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-fwmcz

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b503a8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-b503a8-openshift-default-69548545d9

SuccessfulCreate

Created pod: e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

openshift-ingress

deployment-controller

e2e-extmod-b-b503a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b503a8-openshift-default-69548545d9 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f

SuccessfulCreate

Created pod: e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-b-0e4ce7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f from 2 to 3

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e4ce7-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

Unhealthy

Startup probe failed: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

ProbeError

Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

Unhealthy

Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

ProbeError

Startup probe error: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

ProbeError

Startup probe error: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

Unhealthy

Startup probe failed: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lr9tg

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4c2a28-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4c2a28-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 6 to 5
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 7 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-brv4n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-hj9k7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

Unhealthy

Startup probe failed: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

Unhealthy

Startup probe failed: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

ProbeError

Startup probe error: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

ProbeError

Startup probe error: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

ProbeError

Startup probe error: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

ProbeError

Startup probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

Unhealthy

Startup probe failed: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

Unhealthy

Startup probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-a-w3-bfc240-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-bfc240-openshift-default-857dd6696c from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bfc240-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-pv92x

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

Created

Container created

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 4 to 8

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

AddedInterface

Add eth0 [10.134.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

Started

Container started

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

ProbeError

Startup probe error: Get "http://10.134.0.225:15021/healthz/ready": dial tcp 10.134.0.225:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

Unhealthy

Startup probe failed: Get "http://10.134.0.225:15021/healthz/ready": dial tcp 10.134.0.225:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

ProbeError

Startup probe error: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

Unhealthy

Startup probe failed: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 8 to 10

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

AddedInterface

Add eth0 [10.132.1.30/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

Created

Container created

openshift-ingress

multus

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

Unhealthy

Startup probe failed: Get "http://10.132.1.30:15021/healthz/ready": dial tcp 10.132.1.30:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

ProbeError

Startup probe error: Get "http://10.132.1.30:15021/healthz/ready": dial tcp 10.132.1.30:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-f154ac-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-6jz68

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-f154ac-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc from 3 to 2

models-as-a-service

replicaset-controller

payload-processing-external-model-7988fb85f8

SuccessfulCreate

Created pod: payload-processing-external-model-7988fb85f8-k9qwt
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-7988fb85f8

FailedCreate

Error creating: pods "payload-processing-external-model-7988fb85f8-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7988fb85f8 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-7988fb85f8-k9qwt

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7988fb85f8-k9qwt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7988fb85f8-k9qwt

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7988fb85f8-k9qwt

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-56bdcb5597

SuccessfulCreate

Created pod: payload-processing-external-model-56bdcb5597-tcwmf

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-56bdcb5597 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-56bdcb5597-tcwmf

AddedInterface

Add eth0 [10.134.0.233/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-56bdcb5597-tcwmf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-56bdcb5597-tcwmf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-56bdcb5597-tcwmf

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-a-8b7351-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-8b7351-openshift-default-54db9b4bf7 from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulCreate

Created pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-56bdcb5597-tcwmf

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-65759456

SuccessfulCreate

Created pod: payload-processing-external-model-65759456-sb7cs

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-56bdcb5597 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-56bdcb5597

SuccessfulDelete

Deleted pod: payload-processing-external-model-56bdcb5597-tcwmf

models-as-a-service

multus

payload-processing-external-model-65759456-sb7cs

AddedInterface

Add eth0 [10.132.1.41/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-65759456-sb7cs

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-65759456-sb7cs

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-65759456-sb7cs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-7b9c869b5c

SuccessfulCreate

Created pod: payload-processing-external-model-7b9c869b5c-vrt5q

models-as-a-service

replicaset-controller

payload-processing-external-model-65759456

SuccessfulDelete

Deleted pod: payload-processing-external-model-65759456-sb7cs

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7b9c869b5c from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-65759456

SuccessfulCreate

Created pod: payload-processing-external-model-65759456-22sfn
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-65759456 from 0 to 1
(x4)

models-as-a-service

kubelet

payload-processing-external-model-56bdcb5597-tcwmf

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-001b5c9f6a6a" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7b9c869b5c from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-7b9c869b5c

SuccessfulDelete

Deleted pod: payload-processing-external-model-7b9c869b5c-vrt5q

models-as-a-service

kubelet

payload-processing-external-model-65759456-sb7cs

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-kqcwg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-tsrbh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-g6xz7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-464r7

models-as-a-service

multus

payload-processing-external-model-65759456-22sfn

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-65759456-22sfn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-65759456-22sfn

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-65759456-22sfn

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7988fb85f8-k9qwt

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7988fb85f8

SuccessfulDelete

Deleted pod: payload-processing-external-model-7988fb85f8-k9qwt

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7988fb85f8 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-7988fb85f8-k9qwt

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.172:50052" within 1s: context deadline exceeded

models-as-a-service

kubelet

payload-processing-external-model-56cf4b877-vxgbr

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-56cf4b877 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-56cf4b877

SuccessfulCreate

Created pod: payload-processing-external-model-56cf4b877-vxgbr

models-as-a-service

kubelet

payload-processing-external-model-56cf4b877-vxgbr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-56cf4b877-vxgbr

AddedInterface

Add eth0 [10.134.0.237/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-56cf4b877-vxgbr

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-65759456

SuccessfulDelete

Deleted pod: payload-processing-external-model-65759456-22sfn

openshift-ingress

deployment-controller

e2e-shared-b-w2-660d95-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-660d95-openshift-default-66c7467465 from 4 to 3

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-65759456 from 1 to 0

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-pt2n9

models-as-a-service

kubelet

payload-processing-external-model-65759456-22sfn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g6xz7

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-g6xz7

AddedInterface

Add eth0 [10.132.1.45/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g6xz7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g6xz7

Created

Container created
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g6xz7

ProbeError

Startup probe error: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g6xz7

Unhealthy

Startup probe failed: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tsrbh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tsrbh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tsrbh

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-tsrbh

AddedInterface

Add eth0 [10.134.0.238/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tsrbh

Unhealthy

Startup probe failed: Get "http://10.134.0.238:15021/healthz/ready": dial tcp 10.134.0.238:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tsrbh

ProbeError

Startup probe error: Get "http://10.134.0.238:15021/healthz/ready": dial tcp 10.134.0.238:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tsrbh

Unhealthy

Startup probe failed: Get "http://10.134.0.238:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tsrbh

ProbeError

Startup probe error: Get "http://10.134.0.238:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

replicaset-controller

payload-processing-external-model-788fcb4f8c

SuccessfulCreate

Created pod: payload-processing-external-model-788fcb4f8c-r8p9f

models-as-a-service

kubelet

payload-processing-external-model-788fcb4f8c-r8p9f

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-788fcb4f8c-r8p9f

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-788fcb4f8c-r8p9f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-788fcb4f8c-r8p9f

AddedInterface

Add eth0 [10.132.1.46/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-56cf4b877

SuccessfulDelete

Deleted pod: payload-processing-external-model-56cf4b877-vxgbr

models-as-a-service

kubelet

payload-processing-external-model-56cf4b877-vxgbr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulDelete

Deleted pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 6 to 5

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-pknk9

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-bsqpv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-kqcwg

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-464r7

AddedInterface

Add eth0 [10.132.1.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Unhealthy

Startup probe failed: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

ProbeError

Startup probe error: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Unhealthy

Startup probe failed: Get "http://10.134.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

ProbeError

Startup probe error: Get "http://10.134.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

Unhealthy

Startup probe failed: Get "http://10.132.1.47:15021/healthz/ready": dial tcp 10.132.1.47:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

ProbeError

Startup probe error: Get "http://10.132.1.47:15021/healthz/ready": dial tcp 10.132.1.47:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

ProbeError

Startup probe error: Get "http://10.132.1.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

Unhealthy

Startup probe failed: Get "http://10.132.1.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-588d8bd94c

SuccessfulCreate

Created pod: payload-processing-external-model-588d8bd94c-mztcg

models-as-a-service

replicaset-controller

payload-processing-external-model-588d8bd94c

SuccessfulDelete

Deleted pod: payload-processing-external-model-588d8bd94c-mztcg

models-as-a-service

replicaset-controller

payload-processing-external-model-7b855dbf87

SuccessfulCreate

Created pod: payload-processing-external-model-7b855dbf87-hdcld

models-as-a-service

replicaset-controller

payload-processing-external-model-588d8bd94c

SuccessfulCreate

Created pod: payload-processing-external-model-588d8bd94c-gd9x5

models-as-a-service

replicaset-controller

payload-processing-external-model-7b855dbf87

SuccessfulDelete

Deleted pod: payload-processing-external-model-7b855dbf87-hdcld

models-as-a-service

replicaset-controller

payload-processing-external-model-588d8bd94c

SuccessfulDelete

Deleted pod: payload-processing-external-model-588d8bd94c-gd9x5

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7b855dbf87 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-7b855dbf87

SuccessfulCreate

Created pod: payload-processing-external-model-7b855dbf87-6fjsr

models-as-a-service

replicaset-controller

payload-processing-external-model-588d8bd94c

SuccessfulCreate

Created pod: payload-processing-external-model-588d8bd94c-4cxs6

models-as-a-service

replicaset-controller

payload-processing-external-model-7b855dbf87

SuccessfulDelete

Deleted pod: payload-processing-external-model-7b855dbf87-6fjsr

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7b855dbf87 from 1 to 0
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-588d8bd94c from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dllj6

openshift-ingress

deployment-controller

e2e-shared-a-w3-bfc240-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-bfc240-openshift-default-857dd6696c from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bfc240-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulDelete

Deleted pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulDelete

Deleted pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-mrfkf

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 10 to 7

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-s7c7m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulDelete

Deleted pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-hdmkk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

models-as-a-service

kubelet

payload-processing-external-model-588d8bd94c-4cxs6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-588d8bd94c-4cxs6

Started

Container started

models-as-a-service

multus

payload-processing-external-model-588d8bd94c-4cxs6

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-588d8bd94c-4cxs6

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-788fcb4f8c-r8p9f

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-788fcb4f8c

SuccessfulDelete

Deleted pod: payload-processing-external-model-788fcb4f8c-r8p9f
(x4)

models-as-a-service

kubelet

payload-processing-external-model-788fcb4f8c-r8p9f

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-16659cd0d969" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 10 to 9

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-d5n69

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

ProbeError

Readiness probe error: Get "http://10.132.1.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e7b70d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e7b70d

openshift-ingress

deployment-controller

e2e-inf-a-e7b70d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e7b70d-openshift-default-77f4dd475c from 0 to 1
(x8)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled up replica set payload-processing-external-model-86b5bf4bf from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-86b5bf4bf

SuccessfulCreate

Created pod: payload-processing-external-model-86b5bf4bf-2jszb

models-as-a-service

kubelet

payload-processing-external-model-86b5bf4bf-2jszb

Started

Container started

models-as-a-service

multus

payload-processing-external-model-86b5bf4bf-2jszb

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

AddedInterface

Add eth0 [10.132.1.57/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-86b5bf4bf-2jszb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-86b5bf4bf-2jszb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e4ce7-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e7b70d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e7b70d-7f47c76cdb from 0 to 1

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-0e4ce7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f from 3 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f

SuccessfulDelete

Deleted pod: e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-86g84

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e7b70d-7f47c76cdb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-tz8fb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e7b70d: serviceaccount "payload-processing-e2e-inf-a-e7b70d" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e7b70d-7f47c76cdb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e7b70d: serviceaccount "payload-processing-e2e-inf-a-e7b70d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e7b70d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-tz8fb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-tz8fb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-tz8fb

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-tz8fb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-588d8bd94c

SuccessfulDelete

Deleted pod: payload-processing-external-model-588d8bd94c-4cxs6
(x5)

models-as-a-service

kubelet

payload-processing-external-model-588d8bd94c-4cxs6

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-ee9d78131bed" not found
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-588d8bd94c from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-588d8bd94c-4cxs6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4c2a28-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9

SuccessfulCreate

Created pod: e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

openshift-ingress

deployment-controller

e2e-extmod-b-4c2a28-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

ProbeError

Startup probe error: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

Unhealthy

Startup probe failed: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulDelete

Deleted pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-33e267-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-8b7351-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-8b7351-openshift-default-54db9b4bf7 from 5 to 4

openshift-ingress

deployment-controller

e2e-extmod-a-33e267-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-33e267-openshift-default-85f8d58cb5 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-b24gw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5

SuccessfulCreate

Created pod: e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

openshift-ingress

multus

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

AddedInterface

Add eth0 [10.132.1.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 9 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-ltmdj
(x6)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

Unhealthy

Startup probe failed: Get "http://10.132.1.59:15021/healthz/ready": dial tcp 10.132.1.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

ProbeError

Startup probe error: Get "http://10.132.1.59:15021/healthz/ready": dial tcp 10.132.1.59:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-74dfc6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-74dfc6

openshift-ingress

deployment-controller

e2e-inf-b-74dfc6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-74dfc6-openshift-default-bc45d6cb9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9

SuccessfulCreate

Created pod: e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

openshift-ingress

multus

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-74dfc6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-74dfc6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-74dfc6-587456cfdb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-74dfc6: serviceaccount "payload-processing-e2e-inf-b-74dfc6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-cgkbl
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-74dfc6-587456cfdb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-74dfc6-587456cfdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-74dfc6: serviceaccount "payload-processing-e2e-inf-b-74dfc6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-74dfc6-587456cfdb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-cgkbl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-cgkbl

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-cgkbl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-cgkbl

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulDelete

Deleted pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 7 to 6

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-trt6p

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

models-as-a-service

kubelet

payload-processing-external-model-86b5bf4bf-2jszb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-inf-a-28b78c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-28b78c

openshift-ingress

deployment-controller

e2e-inf-a-28b78c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-28b78c-openshift-default-856b7f6fdc from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-28b78c-openshift-default-856b7f6fdc

SuccessfulCreate

Created pod: e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk
(x6)

openshift-ingress

kubelet

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

ProbeError

Startup probe error: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

Unhealthy

Startup probe failed: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-74dfc6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-74dfc6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-74dfc6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-74dfc6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e7b70d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-e7b70d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e7b70d-openshift-default-77f4dd475c from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e7b70d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-e7b70d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e7b70d-openshift-default-77f4dd475c from 2 to 4

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk
(x2)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

Unhealthy

Startup probe failed: Get "http://10.132.1.57:15021/healthz/ready": dial tcp 10.132.1.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

ProbeError

Startup probe error: Get "http://10.132.1.57:15021/healthz/ready": dial tcp 10.132.1.57:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e7b70d-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

openshift-ingress

deployment-controller

e2e-inf-a-e7b70d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e7b70d-openshift-default-77f4dd475c from 4 to 8

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

Started

Container started

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d2aa3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d2aa3b

openshift-ingress

deployment-controller

e2e-inf-a-d2aa3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d2aa3b-openshift-default-6d55565c69 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-d2aa3b-openshift-default-6d55565c69

SuccessfulCreate

Created pod: e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

openshift-ingress

multus

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

AddedInterface

Add eth0 [10.132.1.70/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-759b04

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-759b04

openshift-ingress

deployment-controller

e2e-inf-a-759b04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-759b04-openshift-default-5549dc77fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-759b04-openshift-default-5549dc77fc

SuccessfulCreate

Created pod: e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d2aa3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d2aa3b-b894cb6db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-stg9k

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d2aa3b-b894cb6db-7kg45

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d2aa3b-b894cb6db

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d2aa3b-b894cb6db-7kg45

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d2aa3b-b894cb6db-7kg45

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-d2aa3b-b894cb6db-7kg45

AddedInterface

Add eth0 [10.134.0.250/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d2aa3b: serviceaccount "payload-processing-e2e-inf-a-d2aa3b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d2aa3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d2aa3b-b894cb6db

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d2aa3b-b894cb6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d2aa3b: serviceaccount "payload-processing-e2e-inf-a-d2aa3b" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d2aa3b-b894cb6db-7kg45

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-stg9k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

Unhealthy

Startup probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-stg9k

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

ProbeError

Startup probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-stg9k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-stg9k

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d2aa3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d2aa3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-5l7q4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

Unhealthy

Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

ProbeError

Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
(x31)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Unhealthy

Readiness probe failed: Get "https://10.132.0.51:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

ProbeError

Readiness probe error: Get "http://10.132.1.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

ProbeError

Readiness probe error: Get "http://10.132.0.44:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

Unhealthy

Readiness probe failed: Get "http://10.132.1.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x12)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-28b78c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w2-660d95-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-660d95-openshift-default-66c7467465 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-660d95-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-xgffv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-8b7351-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-8b7351-openshift-default-54db9b4bf7 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulDelete

Deleted pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-wjpxf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

(combined from similar events): New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulDelete

Deleted pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-g8w8p

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-9rntr

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

Started

Container started

openshift-ingress

multus

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

AddedInterface

Add eth0 [10.134.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

Started

Container started

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

AddedInterface

Add eth0 [10.134.0.252/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulDelete

Deleted pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 6 to 5

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xvlbs

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-tq8rs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 6 to 5
(x8)

openshift-ingress

kubelet

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

Unhealthy

Startup probe failed: Get "http://10.134.0.251:15021/healthz/ready": dial tcp 10.134.0.251:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

ProbeError

Startup probe error: Get "http://10.134.0.251:15021/healthz/ready": dial tcp 10.134.0.251:15021: connect: connection refused body:
(x13)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-28b78c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub-operator-system

opendatahub-operator-controller-manager-8464c976fd-8g6hn_cf75ef40-6817-4525-93c5-b274cad50f92

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-8464c976fd-8g6hn_cf75ef40-6817-4525-93c5-b274cad50f92 became leader
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-759b04-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

odh-model-controller-769875db56-zpphn

Killing

Stopping container manager
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-759b04-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

ProbeError

Startup probe error: Get "http://10.134.0.252:15021/healthz/ready": dial tcp 10.134.0.252:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

Unhealthy

Startup probe failed: Get "http://10.134.0.252:15021/healthz/ready": dial tcp 10.134.0.252:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

Unhealthy

Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

AddedInterface

Add eth0 [10.134.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

Started

Container started
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

ProbeError

Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused body:

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-w9ppp

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

odh-model-controller-769875db56-w9ppp

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-w9ppp

AddedInterface

Add eth0 [10.134.0.254/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-w9ppp

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-w9ppp

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-w9ppp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 560ms (560ms including waiting). Image size: 236755567 bytes.
(x12)

openshift-ingress

kubelet

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

Unhealthy

Startup probe failed: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

Unhealthy

Startup probe failed: Get "http://10.134.0.253:15021/healthz/ready": dial tcp 10.134.0.253:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

ProbeError

Startup probe error: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

ProbeError

Startup probe error: Get "http://10.134.0.253:15021/healthz/ready": dial tcp 10.134.0.253:15021: connect: connection refused body:

opendatahub

odh-model-controller-769875db56-w9ppp_2ab9874f-f47b-4b1b-a9f8-d8232c70a0bb

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-w9ppp_2ab9874f-f47b-4b1b-a9f8-d8232c70a0bb became leader

openshift-ingress

node-controller

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

NodeNotReady

Node is not ready

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

ComponentUnhealthy

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

node-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

NodeNotReady

Node is not ready

opendatahub-operator-system

node-controller

opendatahub-operator-controller-manager-8464c976fd-9b8p5

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

NodeNotReady

Node is not ready

llm

node-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

NodeNotReady

Node is not ready

kuadrant-system

node-controller

authorino-66b59d468d-5bfd2

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

NodeNotReady

Node is not ready

kuadrant-system

node-controller

limitador-operator-controller-manager-5778bb4449-slpzw

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

NodeNotReady

Node is not ready

llm

node-controller

echo-simulator-kserve-64b6f8f96c-d7wsq

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

NodeNotReady

Node is not ready

openshift-ingress

node-controller

maas-default-gateway-openshift-default-855f9574cf-vznnm

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

NodeNotReady

Node is not ready

openshift-ingress

node-controller

maas-default-gateway-openshift-default-855f9574cf-464r7

NodeNotReady

Node is not ready

kuadrant-system

node-controller

authorino-operator-7b7bb4bc77-nj52h

NodeNotReady

Node is not ready

openshift-ingress

node-controller

maas-default-gateway-openshift-default-855f9574cf-7krsk

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

NodeNotReady

Node is not ready

llm

node-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

NodeNotReady

Node is not ready

openshift-ingress

node-controller

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

NodeNotReady

Node is not ready

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

ComponentUnhealthy

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

node-controller

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

NodeNotReady

Node is not ready

openshift-ingress

node-controller

maas-default-gateway-openshift-default-855f9574cf-g6xz7

NodeNotReady

Node is not ready

openshift-jobset-operator

node-controller

jobset-controller-manager-5d9f95b69-9vwq7

NodeNotReady

Node is not ready

kuadrant-system

node-controller

dns-operator-controller-manager-8557cbdb84-c2m84

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

NodeNotReady

Node is not ready

openshift-ingress

node-controller

router-default-f7b87d695-cwlfq

NodeNotReady

Node is not ready

llm

node-controller

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

NodeNotReady

Node is not ready

openshift-ingress

node-controller

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

NodeNotReady

Node is not ready

openshift-ingress

node-controller

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

NodeNotReady

Node is not ready

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

openshift-ingress

node-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

NodeNotReady

Node is not ready

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

ComponentUnhealthy

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

node-controller

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

NodeNotReady

Node is not ready

openshift-ingress

node-controller

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

NodeNotReady

Node is not ready

openshift-ingress

node-controller

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

NodeNotReady

Node is not ready
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-759b04-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-759b04-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

Killing

Container istio-proxy failed startup probe, will be restarted
(x2)

openshift-ingress

kubelet

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-759b04-openshift-default-5549dc77fc-gn8qn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

AddedInterface

Add eth0 [10.134.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceNotReady

LLMInferenceService [echo-simulator] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x6)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

ProbeError

Startup probe error: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

Unhealthy

Startup probe failed: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceNotReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceNotReady

LLMInferenceService [e2e-distinct-simulated] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

kubelet

e2e-inf-a-28b78c-openshift-default-856b7f6fdc-kdmsk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

Unhealthy

Startup probe failed: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

ProbeError

Startup probe error: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused body:
(x12)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-98529d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 8 to 6

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d2aa3b-b894cb6db-7kg45

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-inf-a-086365-openshift-default-65b8db699f

SuccessfulCreate

Created pod: e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

openshift-ingress

gateway_labeler_controller

e2e-inf-a-086365

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-086365

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d2aa3b-6c4ff9988c-stg9k

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-inf-a-086365-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-086365-openshift-default-65b8db699f from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

AddedInterface

Add eth0 [10.134.1.0/23] from ovn-kubernetes
(x11)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d2aa3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x13)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a0d4ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x13)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-33e267-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-086365-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-086365-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x12)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d2aa3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-mt-96230c5b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-96230c5b

openshift-ingress

replicaset-controller

e2e-mt-96230c5b-openshift-default-6bf67c8897

SuccessfulCreate

Created pod: e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

openshift-ingress

deployment-controller

e2e-mt-96230c5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-96230c5b-openshift-default-6bf67c8897 from 0 to 1
(x14)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-942930-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x14)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-942930-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x14)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x14)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-086365-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-086365-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-086365-openshift-default-65b8db699f-jqqcg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

Started

Container started

openshift-ingress

kubelet

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

Created

Container created

openshift-ingress

kubelet

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-96230c5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-96230c5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 5 to 4

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulDelete

Deleted pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-96230c5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-96230c5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3fbb1a-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-3fbb1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c

SuccessfulDelete

Deleted pod: e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 4 to 3

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulDelete

Deleted pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-4269c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-96230c5b-openshift-default-6bf67c8897-gbdjm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7b70d-7f47c76cdb-tz8fb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q

Killing

Stopping container payload-pre-processing
(x23)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x23)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7b70d-746cc7f89f-gjp7q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x25)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-33e267-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

taint-eviction-controller

authorino-66b59d468d-5bfd2

TaintManagerEviction

Marking for deletion Pod kuadrant-system/authorino-66b59d468d-5bfd2

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

openshift-ingress

taint-eviction-controller

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

openshift-ingress

replicaset-controller

e2e-shared-b-w1-43c674-openshift-default-695d458dd9

SuccessfulCreate

Created pod: e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

openshift-ingress

taint-eviction-controller

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

NeedsReinstall

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

openshift-ingress

taint-eviction-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-32e482-5647cf6c5b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

openshift-ingress

taint-eviction-controller

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

TaintManagerEviction

Marking for deletion Pod openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l5g9c

openshift-ingress

taint-eviction-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-nt297

kuadrant-system

replicaset-controller

authorino-66b59d468d

SuccessfulCreate

Created pod: authorino-66b59d468d-j8ndl

kuadrant-system

taint-eviction-controller

authorino-operator-7b7bb4bc77-nj52h

TaintManagerEviction

Marking for deletion Pod kuadrant-system/authorino-operator-7b7bb4bc77-nj52h

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-m8r2s

Killing

Stopping container istio-proxy

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

openshift-ingress

taint-eviction-controller

router-default-f7b87d695-cwlfq

TaintManagerEviction

Marking for deletion Pod openshift-ingress/router-default-f7b87d695-cwlfq

openshift-ingress

taint-eviction-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

openshift-ingress

taint-eviction-controller

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

Killing

Stopping container istio-proxy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallCheckFailed

install timeout

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

llm

taint-eviction-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

TaintManagerEviction

Marking for deletion Pod llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

openshift-ingress

replicaset-controller

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c

SuccessfulCreate

Created pod: e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

llm

taint-eviction-controller

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

TaintManagerEviction

Marking for deletion Pod llm/e2e-distinct-simulated-kserve-7b998b79d9-tf75l

openshift-ingress

taint-eviction-controller

maas-default-gateway-openshift-default-855f9574cf-g6xz7

TaintManagerEviction

Marking for deletion Pod openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-g6xz7

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3fbb1a-755f448d4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

openshift-ingress

taint-eviction-controller

maas-default-gateway-openshift-default-855f9574cf-7krsk

TaintManagerEviction

Marking for deletion Pod openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-7krsk

openshift-ingress

replicaset-controller

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc

SuccessfulCreate

Created pod: e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

openshift-ingress

taint-eviction-controller

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

llm

taint-eviction-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

TaintManagerEviction

Marking for deletion Pod llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

openshift-ingress

taint-eviction-controller

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

TaintManagerEviction

Marking for deletion Pod openshift-ingress/data-science-gateway-data-science-gateway-class-68d996c557ztrnm

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68d996c557

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68d996c557ghsgt

openshift-ingress

taint-eviction-controller

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

openshift-ingress

taint-eviction-controller

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

openshift-ingress

taint-eviction-controller

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

openshift-ingress

taint-eviction-controller

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

openshift-ingress

replicaset-controller

e2e-shared-a-w4-942930-openshift-default-548c4f9d89

SuccessfulCreate

Created pod: e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

openshift-ingress

taint-eviction-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

openshift-ingress

taint-eviction-controller

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

openshift-ingress

taint-eviction-controller

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

openshift-ingress

taint-eviction-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

openshift-ingress

taint-eviction-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

openshift-ingress

replicaset-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5

SuccessfulCreate

Created pod: e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

openshift-ingress

taint-eviction-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

openshift-ingress

taint-eviction-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

openshift-ingress

taint-eviction-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-2b5703-7c44b968cb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65

openshift-ingress

taint-eviction-controller

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

openshift-ingress

taint-eviction-controller

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

openshift-ingress

taint-eviction-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

openshift-ingress

replicaset-controller

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f

SuccessfulCreate

Created pod: e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

openshift-ingress

taint-eviction-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

openshift-ingress

taint-eviction-controller

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

TaintManagerEviction

Marking for deletion Pod openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lf9vc

openshift-ingress

taint-eviction-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

openshift-ingress

taint-eviction-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

openshift-ingress

replicaset-controller

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9

SuccessfulCreate

Created pod: e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

Killing

Stopping container istio-proxy

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

openshift-ingress

taint-eviction-controller

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

openshift-ingress

taint-eviction-controller

maas-default-gateway-openshift-default-855f9574cf-vznnm

TaintManagerEviction

Marking for deletion Pod openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-vznnm

openshift-ingress

replicaset-controller

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59

SuccessfulCreate

Created pod: e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-dcrh4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

openshift-ingress

taint-eviction-controller

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

kuadrant-system

taint-eviction-controller

dns-operator-controller-manager-8557cbdb84-c2m84

TaintManagerEviction

Marking for deletion Pod kuadrant-system/dns-operator-controller-manager-8557cbdb84-c2m84

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

openshift-ingress

taint-eviction-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

openshift-ingress

taint-eviction-controller

maas-default-gateway-openshift-default-855f9574cf-464r7

TaintManagerEviction

Marking for deletion Pod openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-464r7

openshift-ingress

taint-eviction-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

openshift-jobset-operator

taint-eviction-controller

jobset-controller-manager-5d9f95b69-9vwq7

TaintManagerEviction

Marking for deletion Pod openshift-jobset-operator/jobset-controller-manager-5d9f95b69-9vwq7

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-98529d-5857fc5786

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

openshift-ingress

taint-eviction-controller

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

openshift-ingress

taint-eviction-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-9b4747bc

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

openshift-ingress

taint-eviction-controller

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

openshift-ingress

taint-eviction-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb

kuadrant-system

taint-eviction-controller

limitador-operator-controller-manager-5778bb4449-slpzw

TaintManagerEviction

Marking for deletion Pod kuadrant-system/limitador-operator-controller-manager-5778bb4449-slpzw

openshift-ingress

taint-eviction-controller

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

openshift-ingress

taint-eviction-controller

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

llm

taint-eviction-controller

echo-simulator-kserve-64b6f8f96c-d7wsq

TaintManagerEviction

Marking for deletion Pod llm/echo-simulator-kserve-64b6f8f96c-d7wsq

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a0d4ec-576fcc686

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulCreate

Created pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

openshift-ingress

taint-eviction-controller

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

TaintManagerEviction

Marking for deletion Pod openshift-ingress/openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

openshift-ingress

taint-eviction-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

TaintManagerEviction

Marking for deletion Pod openshift-ingress/payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-lcqfr

opendatahub-operator-system

taint-eviction-controller

opendatahub-operator-controller-manager-8464c976fd-9b8p5

TaintManagerEviction

Marking for deletion Pod opendatahub-operator-system/opendatahub-operator-controller-manager-8464c976fd-9b8p5

openshift-ingress

taint-eviction-controller

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

TaintManagerEviction

Marking for deletion Pod openshift-ingress/e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb

Created

Container created

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-mnmjc
(x7)

openshift-ingress

replicaset-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c

SuccessfulCreate

(combined from similar events): Created pod: e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-2vf4r

openshift-ingress

replicaset-controller

router-default-f7b87d695

SuccessfulCreate

Created pod: router-default-f7b87d695-dwgqt

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-dh8xz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557ghsgt

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-cmtzs

openshift-ingress

replicaset-controller

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55

SuccessfulCreate

Created pod: e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-74dfc6-587456cfdb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68d996c557

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68d996c557dng2q

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-5d9f95b69

SuccessfulCreate

Created pod: jobset-controller-manager-5d9f95b69-x7n2b

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-78xj2

openshift-ingress

kubelet

payload-processing-e2e-inf-b-74dfc6-587456cfdb-csd47

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465

SuccessfulCreate

Created pod: e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

openshift-ingress

replicaset-controller

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9

SuccessfulCreate

Created pod: e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c

SuccessfulCreate

Created pod: e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-phpvf

openshift-ingress

replicaset-controller

e2e-extmod-a-98529d-openshift-default-5bd85f96bf

SuccessfulCreate

Created pod: e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557ghsgt

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qsh2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557ghsgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-5sk9w

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-pmwn5
(x3)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

Killing

Stopping container istio-proxy
(x3)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-ingress

replicaset-controller

e2e-extmod-b-0e1546-openshift-default-657f9d4657

SuccessfulCreate

Created pod: e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

openshift-ingress

replicaset-controller

e2e-extmod-b-b503a8-openshift-default-69548545d9

SuccessfulCreate

Created pod: e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

openshift-ingress

replicaset-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5

SuccessfulCreate

Created pod: e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-2b5703-7c44b968cb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb

AddedInterface

Add eth0 [10.134.1.6/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68d996c557ghsgt

AddedInterface

Add eth0 [10.133.1.10/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8464c976fd

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8464c976fd-dgdfv

openshift-ingress

multus

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65

AddedInterface

Add eth0 [10.133.1.11/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-v5xhc

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-w9ppp

Killing

Stopping container manager

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-7pflb

Killing

Stopping container payload-pre-processing

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-fzr95

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65

Killing

Stopping container payload-processing

kuadrant-system

multus

authorino-66b59d468d-j8ndl

AddedInterface

Add eth0 [10.133.1.12/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-7dmwc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e7b70d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557ghsgt

Killing

Stopping container istio-proxy

kuadrant-system

kubelet

authorino-66b59d468d-j8ndl

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-rgr65

Started

Container started

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-phpvf

AddedInterface

Add eth0 [10.134.1.10/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallCheckFailed

install timeout

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-phpvf

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-phpvf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

NeedsReinstall

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-b7d9f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-phpvf

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-phpvf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 524ms (524ms including waiting). Image size: 98346788 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallCheckFailed

install timeout
(x3)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-mrnwk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-kqcwg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-xdzdn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-qnrd5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallCheckFailed

install timeout
(x3)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

authorino-66b59d468d-j8ndl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.933s (2.933s including waiting). Image size: 204096810 bytes.
(x3)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

authorino-66b59d468d-j8ndl

Started

Container started

kuadrant-system

kubelet

authorino-66b59d468d-j8ndl

Created

Container created
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x4)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
(x5)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

AddedInterface

Add eth0 [10.133.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-f7b87d695-dwgqt

Started

Container started

openshift-ingress

kubelet

router-default-f7b87d695-dwgqt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-f7b87d695-dwgqt

Created

Container created

openshift-ingress

multus

router-default-f7b87d695-dwgqt

AddedInterface

Add eth0 [10.133.1.17/23] from ovn-kubernetes
(x5)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

AddedInterface

Add eth0 [10.134.1.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

ProbeError

Liveness probe error: Get "http://10.132.0.44:8081/healthz": dial tcp 10.132.0.44:8081: connect: connection refused body:
(x2)

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

ProbeError

Readiness probe error: Get "http://10.132.0.44:8081/readyz": dial tcp 10.132.0.44:8081: connect: connection refused body:
(x2)

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:8081/readyz": dial tcp 10.132.0.44:8081: connect: connection refused
(x2)

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Unhealthy

Liveness probe failed: Get "http://10.132.0.44:8081/healthz": dial tcp 10.132.0.44:8081: connect: connection refused

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-nj52h

Unhealthy

Liveness probe failed: Get "http://10.132.0.37:8081/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.69:50052" within 1s: context deadline exceeded
(x21)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Unhealthy

Readiness probe failed: Get "https://10.132.0.51:8000/ready": context deadline exceeded

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-nj52h

Unhealthy

Readiness probe failed: Get "http://10.132.0.37:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-slpzw

Unhealthy

Liveness probe failed: Get "http://10.132.0.35:8081/healthz": dial tcp 10.132.0.35:8081: connect: connection refused

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Unhealthy

Liveness probe failed: Get "https://10.132.0.49:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Unhealthy

Liveness probe failed: Get "https://10.132.0.48:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-c2m84

Unhealthy

Liveness probe failed: Get "http://10.132.0.38:8081/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.235:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

Unhealthy

Readiness probe failed: timeout: health rpc did not complete within 1s
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-c2m84

Unhealthy

Readiness probe failed: Get "http://10.132.0.38:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Unhealthy

Readiness probe failed: Get "http://10.132.0.34:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Unhealthy

Liveness probe failed: Get "http://10.132.0.34:8081/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.255:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.234:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.242:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

Unhealthy

Readiness probe failed: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

ProbeError

Readiness probe error: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused body:
(x3)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-slpzw

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:8081/readyz": dial tcp 10.132.0.35:8081: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-slpzw

Pulled

Container image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" already present on machine and can be accessed by the pod

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-pmwn5

AddedInterface

Add eth0 [10.133.1.24/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-pmwn5

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Pulled

Container image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-c2m84

Pulled

Container image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-c2m84

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 984ms (1.026s including waiting). Image size: 273709574 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

Created

Container created
(x2)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-slpzw

Created

Container created
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-c2m84

Created

Container created
(x2)

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Created

Container created
(x2)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-slpzw

Started

Container started
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Started

Container started
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Created

Container created
(x2)

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

Killing

Stopping container discovery

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

Killing

Stopping container router

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

Killing

Stopping container payload-pre-processing

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

Killing

Stopping container main

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

Killing

Stopping container discovery

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

Killing

Stopping container istio-proxy

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Killing

Stopping container main

llm

kubelet

echo-simulator-kserve-64b6f8f96c-d7wsq

Killing

Stopping container main

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g6xz7

Killing

Stopping container istio-proxy

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Killing

Stopping container main

llm

kubelet

echo-simulator-kserve-64b6f8f96c-d7wsq

FailedPreStopHook

PreStopHook failed

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

Killing

Stopping container istio-proxy

kuadrant-system

kubelet

authorino-66b59d468d-5bfd2

Killing

Stopping container authorino

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

Killing

Stopping container istio-proxy

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-nj52h

Killing

Stopping container manager
(x3)

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-inf-a-d2aa3b-openshift-default-dockercfg-g8c6q); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-pmwn5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-pmwn5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.861s (3.862s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-c2m84

Killing

Stopping container manager
(x3)

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

Unhealthy

Startup probe failed: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

ProbeError

Startup probe error: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused body:

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-9vwq7

Killing

Stopping container manager

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

ProbeError

Readiness probe error: Get "http://10.132.0.99:8080/ready": dial tcp 10.132.0.99:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

Unhealthy

Readiness probe failed: Get "http://10.132.0.99:8080/ready": dial tcp 10.132.0.99:8080: connect: connection refused

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-pmwn5

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-slpzw

Killing

Stopping container manager

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

llm

kubelet

echo-simulator-kserve-64b6f8f96c-d7wsq

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": dial tcp 10.132.0.50:8000: connect: connection refused

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-9b8p5

Killing

Stopping container manager

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-464r7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

llm

taint-eviction-controller

echo-simulator-kserve-64b6f8f96c-d7wsq

TaintManagerEviction

Cancelling deletion of Pod llm/echo-simulator-kserve-64b6f8f96c-d7wsq

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

taint-eviction-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-a-33e267-openshift-default-85f8d58cb5-6lfvt

openshift-ingress

taint-eviction-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-s7r4h

llm

taint-eviction-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

TaintManagerEviction

Cancelling deletion of Pod llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-rhvd5

openshift-ingress

taint-eviction-controller

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-inf-a-e7b70d-openshift-default-77f4dd475c-gmfw5

openshift-ingress

taint-eviction-controller

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

openshift-ingress

taint-eviction-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-gn7v5

openshift-ingress

taint-eviction-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

openshift-ingress

taint-eviction-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-mcvtf

openshift-ingress

taint-eviction-controller

maas-default-gateway-openshift-default-855f9574cf-464r7

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-464r7

openshift-ingress

taint-eviction-controller

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-fv9cl

openshift-ingress

taint-eviction-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-nlv6w

openshift-ingress

taint-eviction-controller

router-default-f7b87d695-cwlfq

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/router-default-f7b87d695-cwlfq

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

openshift-ingress

taint-eviction-controller

e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-inf-a-d2aa3b-openshift-default-6d55565c69-7rr6w

openshift-ingress

taint-eviction-controller

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lqrkc

openshift-ingress

taint-eviction-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

openshift-ingress

taint-eviction-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

openshift-ingress

taint-eviction-controller

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

kuadrant-system

taint-eviction-controller

authorino-operator-7b7bb4bc77-nj52h

TaintManagerEviction

Cancelling deletion of Pod kuadrant-system/authorino-operator-7b7bb4bc77-nj52h

kuadrant-system

taint-eviction-controller

limitador-operator-controller-manager-5778bb4449-slpzw

TaintManagerEviction

Cancelling deletion of Pod kuadrant-system/limitador-operator-controller-manager-5778bb4449-slpzw

openshift-ingress

taint-eviction-controller

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

openshift-ingress

taint-eviction-controller

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

openshift-ingress

taint-eviction-controller

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

llm

taint-eviction-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

TaintManagerEviction

Cancelling deletion of Pod llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

kuadrant-system

taint-eviction-controller

dns-operator-controller-manager-8557cbdb84-c2m84

TaintManagerEviction

Cancelling deletion of Pod kuadrant-system/dns-operator-controller-manager-8557cbdb84-c2m84

openshift-ingress

taint-eviction-controller

data-science-gateway-data-science-gateway-class-68d996c557ztrnm

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/data-science-gateway-data-science-gateway-class-68d996c557ztrnm

openshift-ingress

taint-eviction-controller

payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-processing-e2e-extmod-a-98529d-5857fc5786-tchps

opendatahub-operator-system

taint-eviction-controller

opendatahub-operator-controller-manager-8464c976fd-9b8p5

TaintManagerEviction

Cancelling deletion of Pod opendatahub-operator-system/opendatahub-operator-controller-manager-8464c976fd-9b8p5

openshift-ingress

taint-eviction-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-gwvkj

openshift-ingress

taint-eviction-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

openshift-ingress

taint-eviction-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-m6d9d

openshift-ingress

taint-eviction-controller

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-rb8ff

openshift-ingress

taint-eviction-controller

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

openshift-ingress

taint-eviction-controller

istiod-openshift-gateway-7ddd9cfdc8-l5g9c

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l5g9c

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-rpkpj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

taint-eviction-controller

e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-shared-b-w2-660d95-openshift-default-66c7467465-f2v7g

openshift-ingress

taint-eviction-controller

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

openshift-jobset-operator

taint-eviction-controller

jobset-controller-manager-5d9f95b69-9vwq7

TaintManagerEviction

Cancelling deletion of Pod openshift-jobset-operator/jobset-controller-manager-5d9f95b69-9vwq7

openshift-ingress

taint-eviction-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-8pmsk

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-2q8l7

openshift-ingress

taint-eviction-controller

istiod-openshift-gateway-7ddd9cfdc8-lf9vc

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lf9vc

openshift-ingress

taint-eviction-controller

maas-default-gateway-openshift-default-855f9574cf-vznnm

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-vznnm

openshift-ingress

taint-eviction-controller

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-processing-e2e-extmod-a-a0d4ec-576fcc686-wr8l8

openshift-ingress

taint-eviction-controller

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

openshift-ingress

taint-eviction-controller

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-kpmj8

openshift-ingress

taint-eviction-controller

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-n8krl

openshift-ingress

taint-eviction-controller

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-b5d6x

openshift-ingress

taint-eviction-controller

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-8l94r

openshift-ingress

taint-eviction-controller

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-nqclg

openshift-ingress

taint-eviction-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-b-46a6d7-openshift-default-6fc4757985-7lvqd

openshift-ingress

taint-eviction-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

openshift-ingress

taint-eviction-controller

maas-default-gateway-openshift-default-855f9574cf-g6xz7

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-g6xz7

kuadrant-system

taint-eviction-controller

authorino-66b59d468d-5bfd2

TaintManagerEviction

Cancelling deletion of Pod kuadrant-system/authorino-66b59d468d-5bfd2

openshift-ingress

taint-eviction-controller

maas-default-gateway-openshift-default-855f9574cf-7krsk

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-7krsk

openshift-ingress

taint-eviction-controller

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-shared-b-w1-43c674-openshift-default-695d458dd9-pf4gk

openshift-ingress

taint-eviction-controller

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

Created

Container created

llm

taint-eviction-controller

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

TaintManagerEviction

Cancelling deletion of Pod llm/e2e-distinct-simulated-kserve-7b998b79d9-tf75l

openshift-ingress

taint-eviction-controller

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

openshift-ingress

taint-eviction-controller

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

AddedInterface

Add eth0 [10.132.1.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-swkn4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

AddedInterface

Add eth0 [10.132.1.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

ProbeError

Readiness probe error: Get "http://10.132.1.30:15021/healthz/ready": dial tcp 10.132.1.30:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-2tvmn

Unhealthy

Readiness probe failed: Get "http://10.132.1.30:15021/healthz/ready": dial tcp 10.132.1.30:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-bbffd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

AddedInterface

Add eth0 [10.132.1.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

AddedInterface

Add eth0 [10.132.1.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

AddedInterface

Add eth0 [10.132.1.77/23] from ovn-kubernetes
(x3)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-8fbn9

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.70:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

ProbeError

Readiness probe error: Get "http://10.132.1.59:15021/healthz/ready": dial tcp 10.132.1.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-69c9l

Unhealthy

Readiness probe failed: Get "http://10.132.1.59:15021/healthz/ready": dial tcp 10.132.1.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

ProbeError

Readiness probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7krsk

Unhealthy

Readiness probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-z6ftn

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.71:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-xpkd6

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vznnm

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

Unhealthy

Readiness probe failed: Get "http://10.132.0.243:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-ckz5f

ProbeError

Readiness probe error: Get "http://10.132.0.243:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

Created

Container created

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

AddedInterface

Add eth0 [10.132.1.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

Started

Container started

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

AddedInterface

Add eth0 [10.132.1.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

Started

Container started

opendatahub

multus

odh-model-controller-769875db56-fzr95

AddedInterface

Add eth0 [10.132.1.79/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-fzr95

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 586ms (586ms including waiting). Image size: 98346788 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

ProbeError

Readiness probe error: Get "http://10.132.0.254:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-6gnsx

Unhealthy

Readiness probe failed: Get "http://10.132.0.254:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

Unhealthy

Readiness probe failed: Get "http://10.132.0.230:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g6xz7

Unhealthy

Readiness probe failed: Get "http://10.132.1.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-qlt42

ProbeError

Readiness probe error: Get "http://10.132.0.230:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g6xz7

ProbeError

Readiness probe error: Get "http://10.132.1.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-48j44

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.244:50052" within 1s: context deadline exceeded

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

Created

Container created
(x3)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-lfqvq

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.72:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-6487p

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.75:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-4dtv2

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.74:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-fx8mt

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.73:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

ProbeError

Readiness probe error: Get "http://10.132.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

AddedInterface

Add eth0 [10.132.1.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

ProbeError

Readiness probe error: Get "http://10.132.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-x6pbn

Unhealthy

Readiness probe failed: Get "http://10.132.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

AddedInterface

Add eth0 [10.132.1.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rmz2r

Unhealthy

Readiness probe failed: Get "http://10.132.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

AddedInterface

Add eth0 [10.132.1.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

AddedInterface

Add eth0 [10.132.1.86/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

ProbeError

Startup probe error: Get "http://10.132.1.75:15021/healthz/ready": dial tcp 10.132.1.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

ProbeError

Readiness probe error: Get "http://10.132.0.226:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

Unhealthy

Startup probe failed: Get "http://10.132.1.75:15021/healthz/ready": dial tcp 10.132.1.75:15021: connect: connection refused

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

AddedInterface

Add eth0 [10.132.1.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-wbnrj

Unhealthy

Readiness probe failed: Get "http://10.132.0.226:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

AddedInterface

Add eth0 [10.132.1.90/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

AddedInterface

Add eth0 [10.132.1.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

AddedInterface

Add eth0 [10.132.1.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

AddedInterface

Add eth0 [10.132.1.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

AddedInterface

Add eth0 [10.132.1.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

AddedInterface

Add eth0 [10.132.1.91/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

AddedInterface

Add eth0 [10.132.1.113/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-78xj2

AddedInterface

Add eth0 [10.132.1.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

Created

Container created

openshift-ingress

multus

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

AddedInterface

Add eth0 [10.132.1.96/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

AddedInterface

Add eth0 [10.132.1.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

AddedInterface

Add eth0 [10.132.1.93/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68d996c557dng2q

AddedInterface

Add eth0 [10.132.1.97/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

AddedInterface

Add eth0 [10.132.1.94/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

AddedInterface

Add eth0 [10.132.1.100/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-942930-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-5sk9w

AddedInterface

Add eth0 [10.132.1.98/23] from ovn-kubernetes

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-dcrh4

AddedInterface

Add eth0 [10.132.1.99/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 450ms (450ms including waiting). Image size: 98346788 bytes.

openshift-ingress

multus

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

AddedInterface

Add eth0 [10.132.1.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dcrh4

Pulled

Container image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-5sk9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

Started

Container started

openshift-ingress

multus

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

AddedInterface

Add eth0 [10.132.1.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-cmtzs

AddedInterface

Add eth0 [10.132.1.104/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557dng2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Unhealthy

Readiness probe failed: Get "https://10.132.0.49:8000/ready": EOF

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Unhealthy

Readiness probe failed: Get "https://10.132.0.48:8000/ready": EOF

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dcrh4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-5sk9w

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

Unhealthy

Startup probe failed: Get "http://10.132.1.80:15021/healthz/ready": dial tcp 10.132.1.80:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

ProbeError

Startup probe error: Get "http://10.132.1.80:15021/healthz/ready": dial tcp 10.132.1.80:15021: connect: connection refused body:

kuadrant-system

dns-operator-controller-manager-8557cbdb84-pmwn5_f8c08030-fd91-4975-b611-2f553d4c097c

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-pmwn5_f8c08030-fd91-4975-b611-2f553d4c097c became leader

openshift-ingress

kubelet

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

Unhealthy

Startup probe failed: Get "http://10.132.1.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-5sk9w

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

Unhealthy

Readiness probe failed: Get "https://10.132.1.82:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

ProbeError

Startup probe error: Get "http://10.132.1.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dcrh4

Started

Container started
(x6)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Unhealthy

Readiness probe failed: Get "https://10.132.0.48:8000/ready": dial tcp 10.132.0.48:8000: connect: connection refused
(x6)

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Unhealthy

Readiness probe failed: Get "https://10.132.0.49:8000/ready": dial tcp 10.132.0.49:8000: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

ProbeError

Startup probe error: Get "http://10.132.1.88:15021/healthz/ready": dial tcp 10.132.1.88:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

ProbeError

Startup probe error: Get "http://10.132.1.90:15021/healthz/ready": dial tcp 10.132.1.90:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

Unhealthy

Startup probe failed: Get "http://10.132.1.90:15021/healthz/ready": dial tcp 10.132.1.90:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

Unhealthy

Startup probe failed: Get "http://10.132.1.88:15021/healthz/ready": dial tcp 10.132.1.88:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

ProbeError

Startup probe error: Get "http://10.132.1.83:15021/healthz/ready": dial tcp 10.132.1.83:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

Unhealthy

Startup probe failed: Get "http://10.132.1.83:15021/healthz/ready": dial tcp 10.132.1.83:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-dhq95

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

Unhealthy

Startup probe failed: Get "http://10.132.1.84:15021/healthz/ready": dial tcp 10.132.1.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

ProbeError

Startup probe error: Get "http://10.132.1.84:15021/healthz/ready": dial tcp 10.132.1.84:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

Unhealthy

Startup probe failed: Get "http://10.132.1.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

Unhealthy

Startup probe failed: Get "http://10.132.1.96:15021/healthz/ready": dial tcp 10.132.1.96:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

ProbeError

Startup probe error: Get "http://10.132.1.96:15021/healthz/ready": dial tcp 10.132.1.96:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

ProbeError

Startup probe error: Get "http://10.132.1.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Unhealthy

Readiness probe failed: Get "https://10.132.0.48:8000/ready": context deadline exceeded
(x4)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

ProbeError

Startup probe error: Get "http://10.132.1.91:15021/healthz/ready": dial tcp 10.132.1.91:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

Created

Container created
(x4)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

Unhealthy

Startup probe failed: Get "http://10.132.1.91:15021/healthz/ready": dial tcp 10.132.1.91:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

Started

Container started
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

Unhealthy

Startup probe failed: Get "http://10.132.1.102:15021/healthz/ready": dial tcp 10.132.1.102:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

Created

Container created
(x5)

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Unhealthy

Readiness probe failed: Get "https://10.132.0.49:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

Created

Container created
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

ProbeError

Startup probe error: Get "http://10.132.1.102:15021/healthz/ready": dial tcp 10.132.1.102:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557dng2q

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68d996c557dng2q

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-5sk9w

ProbeError

Startup probe error: Get "http://10.132.1.98:15021/healthz/ready": dial tcp 10.132.1.98:15021: connect: connection refused body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-9b4747bc-rwnxn

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-5sk9w

Unhealthy

Startup probe failed: Get "http://10.132.1.98:15021/healthz/ready": dial tcp 10.132.1.98:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

Started

Container started
(x16)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service"
(x17)

llm

LLMInferenceServiceController

e2e-distinct-simulated

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service"

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

openshift-ingress

replicaset-controller

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

openshift-ingress

deployment-controller

e2e-extmod-a-eb69cb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7 from 5 to 3
(x17)

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service"
(x8)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tf75l

Unhealthy

Readiness probe failed: Get "https://10.132.0.48:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb69cb-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x6)

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8whwkp

Unhealthy

Readiness probe failed: Get "https://10.132.0.49:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-w845q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-pfb97

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

ProbeError

Startup probe error: Get "http://10.132.1.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dcrh4_fa5db4c0-c3c1-4ab5-b6a6-9f3cb7f6b24c

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-dcrh4_fa5db4c0-c3c1-4ab5-b6a6-9f3cb7f6b24c became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

Unhealthy

Startup probe failed: Get "http://10.132.1.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

AddedInterface

Add eth0 [10.132.1.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

ProbeError

Startup probe error: Get "http://10.132.1.100:15021/healthz/ready": dial tcp 10.132.1.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

ProbeError

Startup probe error: Get "http://10.132.1.105:15021/healthz/ready": dial tcp 10.132.1.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

Unhealthy

Startup probe failed: Get "http://10.132.1.100:15021/healthz/ready": dial tcp 10.132.1.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

Unhealthy

Startup probe failed: Get "http://10.132.1.105:15021/healthz/ready": dial tcp 10.132.1.105:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

AddedInterface

Add eth0 [10.132.1.109/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

AddedInterface

Add eth0 [10.132.1.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

AddedInterface

Add eth0 [10.132.1.129/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8464c976fd-dgdfv

AddedInterface

Add eth0 [10.132.1.114/23] from ovn-kubernetes

llm

multus

echo-simulator-kserve-64b6f8f96c-mnmjc

AddedInterface

Add eth0 [10.132.1.115/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mnmjc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

multus

jobset-controller-manager-5d9f95b69-x7n2b

AddedInterface

Add eth0 [10.132.1.136/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

AddedInterface

Add eth0 [10.132.1.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

Started

Container started

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

AddedInterface

Add eth0 [10.132.1.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

Created

Container created

openshift-ingress

multus

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

AddedInterface

Add eth0 [10.132.1.111/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

Unhealthy

Startup probe failed: Get "http://10.132.1.104:15021/healthz/ready": dial tcp 10.132.1.104:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

ProbeError

Startup probe error: Get "http://10.132.1.104:15021/healthz/ready": dial tcp 10.132.1.104:15021: connect: connection refused body:

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 1.224s (1.224s including waiting). Image size: 273709574 bytes.

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

AddedInterface

Add eth0 [10.132.1.130/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

AddedInterface

Add eth0 [10.132.1.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

AddedInterface

Add eth0 [10.132.1.116/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-x7n2b

Pulled

Container image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-nt297

AddedInterface

Add eth0 [10.132.1.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

AddedInterface

Add eth0 [10.132.1.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-v5xhc

Pulled

Container image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

Created

Container created

kuadrant-system

multus

authorino-operator-7b7bb4bc77-v5xhc

AddedInterface

Add eth0 [10.132.1.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

AddedInterface

Add eth0 [10.132.1.125/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

AddedInterface

Add eth0 [10.132.1.121/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

AddedInterface

Add eth0 [10.132.1.119/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-7dmwc

AddedInterface

Add eth0 [10.132.1.124/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

AddedInterface

Add eth0 [10.132.1.132/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

AddedInterface

Add eth0 [10.132.1.133/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

AddedInterface

Add eth0 [10.132.1.123/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-x7n2b

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-nt297

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

AddedInterface

Add eth0 [10.132.1.120/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

AddedInterface

Add eth0 [10.132.1.128/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

AddedInterface

Add eth0 [10.132.1.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mnmjc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.445s (1.445s including waiting). Image size: 78208878 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

ProbeError

Startup probe error: Get "http://10.132.1.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

ProbeError

Startup probe error: Get "http://10.132.1.107:15021/healthz/ready": dial tcp 10.132.1.107:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7dmwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

Unhealthy

Startup probe failed: Get "http://10.132.1.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

kubelet

jobset-controller-manager-5d9f95b69-x7n2b

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

Unhealthy

Startup probe failed: Get "http://10.132.1.107:15021/healthz/ready": dial tcp 10.132.1.107:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 500

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 500 body: [+]backend-proxy-http ok [+]has-synced ok [-]process-running failed: reason withheld healthz check failed

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-v5xhc

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

Unhealthy

Liveness probe failed: Get "https://10.132.1.89:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-v5xhc

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

Unhealthy

Readiness probe failed: Get "https://10.132.1.82:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-nt297

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

Created

Container created
(x33)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a0d4ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mnmjc

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-nt297

Started

Container started
(x11)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

Unhealthy

Startup probe failed: Get "http://10.132.1.109:15021/healthz/ready": dial tcp 10.132.1.109:15021: connect: connection refused

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 1.181s (1.193s including waiting). Image size: 273709574 bytes.
(x11)

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

ProbeError

Startup probe error: Get "http://10.132.1.109:15021/healthz/ready": dial tcp 10.132.1.109:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mnmjc

Started

Container started
(x12)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

Unhealthy

Startup probe failed: Get "http://10.132.1.129:15021/healthz/ready": dial tcp 10.132.1.129:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

Unhealthy

Startup probe failed: Get "http://10.132.1.110:15021/healthz/ready": dial tcp 10.132.1.110:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

Started

Container started
(x13)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

ProbeError

Startup probe error: Get "http://10.132.1.129:15021/healthz/ready": dial tcp 10.132.1.129:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

ProbeError

Startup probe error: Get "http://10.132.1.110:15021/healthz/ready": dial tcp 10.132.1.110:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

ProbeError

Readiness probe error: Get "http://10.132.0.9:1936/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

router-default-f7b87d695-cwlfq

Unhealthy

Readiness probe failed: Get "http://10.132.0.9:1936/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x12)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

Unhealthy

Startup probe failed: Get "http://10.132.1.111:15021/healthz/ready": dial tcp 10.132.1.111:15021: connect: connection refused
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

jobset-controller-manager-5d9f95b69-x7n2b_3c0fb527-9e43-4588-8b8e-002431a7d077

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-5d9f95b69-x7n2b_3c0fb527-9e43-4588-8b8e-002431a7d077 became leader
(x12)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

Unhealthy

Startup probe failed: Get "http://10.132.1.131:15021/healthz/ready": dial tcp 10.132.1.131:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

ProbeError

Startup probe error: Get "http://10.132.1.111:15021/healthz/ready": dial tcp 10.132.1.111:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

ProbeError

Startup probe error: Get "http://10.132.1.131:15021/healthz/ready": dial tcp 10.132.1.131:15021: connect: connection refused body:

kuadrant-system

authorino-operator-7b7bb4bc77-v5xhc_870e6655-503d-4e92-9792-bdde52688d7d

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-v5xhc_870e6655-503d-4e92-9792-bdde52688d7d became leader
(x12)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

Unhealthy

Startup probe failed: Get "http://10.132.1.125:15021/healthz/ready": dial tcp 10.132.1.125:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7dmwc

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

Created

Container created
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

Unhealthy

Startup probe failed: Get "http://10.132.1.134:15021/healthz/ready": dial tcp 10.132.1.134:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7dmwc

Started

Container started
(x12)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

Unhealthy

Startup probe failed: Get "http://10.132.1.116:15021/healthz/ready": dial tcp 10.132.1.116:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

ProbeError

Startup probe error: Get "http://10.132.1.134:15021/healthz/ready": dial tcp 10.132.1.134:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

ProbeError

Startup probe error: Get "http://10.132.1.125:15021/healthz/ready": dial tcp 10.132.1.125:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

Started

Container started
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

ProbeError

Startup probe error: Get "http://10.132.1.130:15021/healthz/ready": dial tcp 10.132.1.130:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

Unhealthy

Startup probe failed: Get "http://10.132.1.130:15021/healthz/ready": dial tcp 10.132.1.130:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

Created

Container created
(x13)

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

ProbeError

Startup probe error: Get "http://10.132.1.116:15021/healthz/ready": dial tcp 10.132.1.116:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8464c976fd-dgdfv

Started

Container started
(x17)

llm

LLMInferenceServiceController

echo-simulator

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service"
(x12)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

Unhealthy

Startup probe failed: Get "http://10.132.1.118:15021/healthz/ready": dial tcp 10.132.1.118:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

Unhealthy

Startup probe failed: Get "http://10.132.1.123:15021/healthz/ready": dial tcp 10.132.1.123:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

Unhealthy

Startup probe failed: Get "http://10.132.1.119:15021/healthz/ready": dial tcp 10.132.1.119:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

Started

Container started
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-nt297

Unhealthy

Startup probe failed: Get "http://10.132.1.126:15021/healthz/ready": dial tcp 10.132.1.126:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

Unhealthy

Startup probe failed: Get "http://10.132.1.132:15021/healthz/ready": dial tcp 10.132.1.132:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

Unhealthy

Startup probe failed: Get "http://10.132.1.122:15021/healthz/ready": dial tcp 10.132.1.122:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

Started

Container started
(x12)

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

Unhealthy

Startup probe failed: Get "http://10.132.1.128:15021/healthz/ready": dial tcp 10.132.1.128:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

ProbeError

Startup probe error: Get "http://10.132.1.132:15021/healthz/ready": dial tcp 10.132.1.132:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

ProbeError

Startup probe error: Get "http://10.132.1.119:15021/healthz/ready": dial tcp 10.132.1.119:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-nt297

ProbeError

Startup probe error: Get "http://10.132.1.126:15021/healthz/ready": dial tcp 10.132.1.126:15021: connect: connection refused body:
(x11)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e7b70d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x11)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e7b70d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

ProbeError

Startup probe error: Get "http://10.132.1.122:15021/healthz/ready": dial tcp 10.132.1.122:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

ProbeError

Startup probe error: Get "http://10.132.1.118:15021/healthz/ready": dial tcp 10.132.1.118:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

ProbeError

Startup probe error: Get "http://10.132.1.123:15021/healthz/ready": dial tcp 10.132.1.123:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

ProbeError

Startup probe error: Get "http://10.132.1.128:15021/healthz/ready": dial tcp 10.132.1.128:15021: connect: connection refused body:

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wz2w4

Unhealthy

Readiness probe failed: Get "https://10.132.1.82:8000/ready": context deadline exceeded
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

Unhealthy

Startup probe failed: Get "http://10.132.1.121:15021/healthz/ready": dial tcp 10.132.1.121:15021: connect: connection refused
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors
(x2)

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

Unhealthy

Readiness probe failed: Get "https://10.132.1.89:8000/ready": context deadline exceeded
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

ProbeError

Startup probe error: Get "http://10.132.1.121:15021/healthz/ready": dial tcp 10.132.1.121:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7dmwc

ProbeError

Startup probe error: Get "http://10.132.1.124:15021/healthz/ready": dial tcp 10.132.1.124:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7dmwc

Unhealthy

Startup probe failed: Get "http://10.132.1.124:15021/healthz/ready": dial tcp 10.132.1.124:15021: connect: connection refused

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fx98r

Unhealthy

Readiness probe failed: Get "https://10.132.1.89:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mnmjc

Unhealthy

Readiness probe failed: Get "https://10.132.1.115:8000/ready": context deadline exceeded
(x12)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

Unhealthy

Startup probe failed: Get "http://10.132.1.108:15021/healthz/ready": dial tcp 10.132.1.108:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

ProbeError

Startup probe error: Get "http://10.132.1.120:15021/healthz/ready": dial tcp 10.132.1.120:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

ProbeError

Startup probe error: Get "http://10.132.1.108:15021/healthz/ready": dial tcp 10.132.1.108:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

Unhealthy

Startup probe failed: Get "http://10.132.1.120:15021/healthz/ready": dial tcp 10.132.1.120:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

ProbeError

Startup probe error: Get "http://10.132.1.133:15021/healthz/ready": dial tcp 10.132.1.133:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

Unhealthy

Startup probe failed: Get "http://10.132.1.133:15021/healthz/ready": dial tcp 10.132.1.133:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e7b70d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-a-8b7351-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-8b7351-openshift-default-54db9b4bf7 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8b7351-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7

SuccessfulDelete

Deleted pod: e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

opendatahub

kubelet

odh-model-controller-769875db56-fzr95

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 1m18.722s (1m18.722s including waiting). Image size: 236755567 bytes.

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

Killing

Stopping container istio-proxy

opendatahub

kubelet

odh-model-controller-769875db56-fzr95

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-fzr95

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-vmgsr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x37)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-98529d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-33e267-openshift-default-85f8d58cb5

SuccessfulDelete

Deleted pod: e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-bm2lk

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-33e267-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-33e267-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-33e267-openshift-default-85f8d58cb5 from 2 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-98529d-84f599d4f5-dxgp7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-98529d-5857fc5786-qkmst

Killing

Stopping container payload-processing
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs
(x2)

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready
(x3)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

opendatahub

odh-model-controller-769875db56-fzr95_84f1ec90-a5c1-4299-85ac-44f8e61332f3

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-fzr95_84f1ec90-a5c1-4299-85ac-44f8e61332f3 became leader
(x2)

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs
(x2)

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs
(x2)

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

openshift-ingress

kubelet

e2e-extmod-a-98529d-openshift-default-5bd85f96bf-46d2g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-2qpzk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-r4j9x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-f68ws

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-vlnhr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-hw6z7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-7hfqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-8w76w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e7b70d-openshift-default-77f4dd475c-4pvqn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b503a8-7bf9b44576-cxrst

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-74dfc6-7cc66559cf-cgkbl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-74dfc6-587456cfdb-flcjp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-46a6d7-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-46a6d7-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-extmod-b-46a6d7-openshift-default-6fc4757985 from 3 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-46a6d7-openshift-default-6fc4757985

SuccessfulDelete

Deleted pod: e2e-extmod-b-46a6d7-openshift-default-6fc4757985-6g2m6

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

ProbeError

Readiness probe error: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-rb5vt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-74dfc6-openshift-default-bc45d6cb9-fxvzx

Unhealthy

Readiness probe failed: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

AddedInterface

Add eth0 [10.132.1.149/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-836265-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-836265-openshift-default-67b9f59555 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-836265-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w2-836265-openshift-default-67b9f59555

SuccessfulCreate

Created pod: e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-b503a8-openshift-default-69548545d9-r5bq7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0d4ec-7db9f85699-9np8t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0d4ec-576fcc686-zvkt9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-942930-78c5bcb55-wmdcf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-942930-674dbf8f98-5tmhl

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

ProbeError

Startup probe error: Get "http://10.132.1.149:15021/healthz/ready": dial tcp 10.132.1.149:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

Unhealthy

Startup probe failed: Get "http://10.132.1.149:15021/healthz/ready": dial tcp 10.132.1.149:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b503a8-78fd8f8ff5-fjfjp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-942930-openshift-default-548c4f9d89-rdm62

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-a0d4ec-openshift-default-698f57dbd9-bcfqs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-88a18e-88bc6576-zdcn4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-88a18e-7b86865bf5-2nmsp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e1546-84f49b7cd8-qj9lt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e1546-76fc58fc67-hqpgm

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bcfde8-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

AddedInterface

Add eth0 [10.134.1.20/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w1-43c674-openshift-default-695d458dd9

SuccessfulCreate

Created pod: e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

openshift-ingress

deployment-controller

e2e-shared-b-w3-bcfde8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55 from 2 to 3

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55

SuccessfulCreate

Created pod: e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

openshift-ingress

deployment-controller

e2e-shared-b-w1-43c674-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-43c674-openshift-default-695d458dd9 from 2 to 3

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-43c674-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

Created

Container created

openshift-ingress

multus

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

AddedInterface

Add eth0 [10.132.1.151/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-qznmf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-0e1546-openshift-default-657f9d4657-p545l

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

Unhealthy

Startup probe failed: Get "http://10.134.1.20:15021/healthz/ready": dial tcp 10.134.1.20:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

ProbeError

Startup probe error: Get "http://10.134.1.20:15021/healthz/ready": dial tcp 10.134.1.20:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

ProbeError

Startup probe error: Get "http://10.132.1.151:15021/healthz/ready": dial tcp 10.132.1.151:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

Unhealthy

Startup probe failed: Get "http://10.132.1.151:15021/healthz/ready": dial tcp 10.132.1.151:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-wtkzx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-88a18e-openshift-default-7687cc86c-8j7v4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4fb1d0-86df6f5d94-b8pcg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4fb1d0-7958c77cb7-cs7sz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w0-4fb1d0-openshift-default-85c7dddd6f-56f6f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-81a5ae-9c66fb5b-nqjxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-81a5ae-84ff5c8d59-gtfbc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fbb1a-755f448d4-7dhl8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fbb1a-66d698c4cf-r7j7h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-5xlqj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-81a5ae-openshift-default-59cb685c59-xvgzx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d3d0df-6ff8d4b9ff-dw4kb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d3d0df-c85975868-kxxcm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-5rzpc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-qgbf4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-3fbb1a-openshift-default-6f4dd6d84c-lg2sm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

openshift-ingress

replicaset-controller

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7

SuccessfulCreate

Created pod: e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d3d0df-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-d3d0df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7 from 4 to 6

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

Created

Container created

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

AddedInterface

Add eth0 [10.134.1.21/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

AddedInterface

Add eth0 [10.132.1.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

Unhealthy

Startup probe failed: Get "http://10.132.1.156:15021/healthz/ready": dial tcp 10.132.1.156:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

ProbeError

Startup probe error: Get "http://10.132.1.156:15021/healthz/ready": dial tcp 10.132.1.156:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

Unhealthy

Startup probe failed: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

ProbeError

Startup probe error: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-cm8xl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-nzqgg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-6lxfp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-kjllh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-fs8mz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

Unhealthy

Readiness probe failed: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-d3d0df-openshift-default-7b6bc448b7-mkbpq

ProbeError

Readiness probe error: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused body:

opendatahub

multus

test-curl-7243-900536

AddedInterface

Add eth0 [10.132.1.160/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7243-900536

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7243-900536

Created

Container created

opendatahub

kubelet

test-curl-7243-900536

Started

Container started

opendatahub

kubelet

test-curl-7243-3ef9d3

Created

Container created

opendatahub

kubelet

test-curl-7243-3ef9d3

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7243-3ef9d3

AddedInterface

Add eth0 [10.132.1.161/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7243-3ef9d3

Started

Container started

opendatahub

kubelet

test-curl-7243-900536

Killing

Stopping container test-curl-7243-900536

opendatahub

kubelet

test-curl-7243-3ef9d3

Killing

Stopping container test-curl-7243-3ef9d3

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-eb69cb-578f87d45d-slgsc

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w1-43c674-openshift-default-695d458dd9

SuccessfulCreate

Created pod: e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

openshift-ingress

deployment-controller

e2e-shared-b-w1-43c674-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-43c674-openshift-default-695d458dd9 from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-43c674-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

Unhealthy

Startup probe failed: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

ProbeError

Startup probe error: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-nt297

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-855f9574cf-nt297

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-855f9574cf-7dmwc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-855f9574cf from 10 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-7dmwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-s9d4b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb69cb-59567676d7-97lcd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-5lvpg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-eb69cb-openshift-default-5f5b7678f7-vplgt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-46a6d7-86dcdbbcf9-sl229

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-46a6d7-fbf745886-grqvg

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulDelete

Deleted pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-t2d5l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-33e267-7fb8df65fb-6ctzd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-33e267-867b6cfb59-lsm58

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-24x67

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-46a6d7-openshift-default-6fc4757985-xbz4q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-33e267-openshift-default-85f8d58cb5-vhbf2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8b7351-5fc98886d-twv27

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-k7cxn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-836265-openshift-default-67b9f59555-b4k5w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4c2a28-86b687fd6-z8rqf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4c2a28-79968ddbb7-jh9ls

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-fzkth

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-4c2a28-openshift-default-7b6689f6b9-w282c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-nzb4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-8b7351-openshift-default-54db9b4bf7-jsgds

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-836265-7cd9bb4d68-7dtlq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-836265-855b654cbc-6rlrd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8b7351-6494fb69f5-q99gm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f154ac-7b4cd44795-7clrt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f154ac-6d9544787d-zr84z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cmxzw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e4ce7-698bd89b46-b4vbq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-660d95-openshift-default-66c7467465-cvxvh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-2p4pn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-f154ac-openshift-default-6f556bf4cc-qprm5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-660d95-8474b9648b-78rhc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-660d95-84bf7f47d7-q7ncx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e4ce7-79485df6f9-mz6ng

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.133:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2b5703-869468bbc5-546nh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-4bbvh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2b5703-7c44b968cb-g457m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-0e4ce7-openshift-default-779c8bf98f-5p252

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-43c674-bf97746fd-vzmjm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-43c674-66c7dd866c-dl2t2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bfc240-5649698867-hsr2v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bfc240-76778fd956-68nbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-jhdp5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-rlzn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-j2rzz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-43c674-openshift-default-695d458dd9-nznsm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 3 to 6

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

Started

Container started

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

AddedInterface

Add eth0 [10.132.1.173/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

AddedInterface

Add eth0 [10.134.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

Created

Container created

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

AddedInterface

Add eth0 [10.132.1.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-s6mnz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bfc240-openshift-default-857dd6696c-dbx4s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bcfde8-95f87c9cb-bxvrr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bcfde8-78bcbccdf9-pbsmc

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

Unhealthy

Startup probe failed: Get "http://10.132.1.173:15021/healthz/ready": dial tcp 10.132.1.173:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

Unhealthy

Startup probe failed: Get "http://10.132.1.172:15021/healthz/ready": dial tcp 10.132.1.172:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

ProbeError

Startup probe error: Get "http://10.132.1.172:15021/healthz/ready": dial tcp 10.132.1.172:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

ProbeError

Startup probe error: Get "http://10.132.1.173:15021/healthz/ready": dial tcp 10.132.1.173:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-32e482-5647cf6c5b-mx7tn

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

Unhealthy

Startup probe failed: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-32e482-5799655ddc-rrj8c

Killing

Stopping container payload-pre-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

ProbeError

Startup probe error: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulDelete

Deleted pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

openshift-ingress

replicaset-controller

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7

SuccessfulCreate

Created pod: e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

openshift-ingress

deployment-controller

e2e-worker-w2-2b5703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2b5703-openshift-default-779f8fb9b7 from 6 to 7

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2b5703-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 4 to 3

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

AddedInterface

Add eth0 [10.132.1.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-fgtxf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lcqfr

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-lcqfr

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-667s6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-l7ghz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

ProbeError

Startup probe error: Get "http://10.132.1.175:15021/healthz/ready": dial tcp 10.132.1.175:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-bcfde8-openshift-default-69fd758c55-kz6hk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

Unhealthy

Startup probe failed: Get "http://10.132.1.175:15021/healthz/ready": dial tcp 10.132.1.175:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-855f9574cf from 8 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-855f9574cf-78xj2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-78xj2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9f46e5-7b7655d547-smrhb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

Created

Container created

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

AddedInterface

Add eth0 [10.132.1.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9f46e5-74d4f56bf8-b6x8q

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

AddedInterface

Add eth0 [10.132.1.180/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

AddedInterface

Add eth0 [10.132.1.178/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-32e482-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-32e482-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c

SuccessfulCreate

Created pod: e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-dh77s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-76h6v

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

ProbeError

Startup probe error: Get "http://10.132.1.178:15021/healthz/ready": dial tcp 10.132.1.178:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

ProbeError

Startup probe error: Get "http://10.132.1.179:15021/healthz/ready": dial tcp 10.132.1.179:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

Unhealthy

Startup probe failed: Get "http://10.132.1.179:15021/healthz/ready": dial tcp 10.132.1.179:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

Unhealthy

Startup probe failed: Get "http://10.132.1.180:15021/healthz/ready": dial tcp 10.132.1.180:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

ProbeError

Startup probe error: Get "http://10.132.1.180:15021/healthz/ready": dial tcp 10.132.1.180:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-rrvsz

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

Unhealthy

Startup probe failed: Get "http://10.132.1.178:15021/healthz/ready": dial tcp 10.132.1.178:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-46gtd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-x8dkw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-32e482-openshift-default-7cfdc6fb4c-wbpch

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-67f2j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-2lzks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-4pz9h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-crz79

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-5c6w7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-rhcqd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-2b5703-openshift-default-779f8fb9b7-hztmm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9f46e5-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-9f46e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f from 3 to 6

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

Started

Container started

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

AddedInterface

Add eth0 [10.132.1.182/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

Created

Container created

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

AddedInterface

Add eth0 [10.134.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f

SuccessfulCreate

Created pod: e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

Created

Container created

openshift-ingress

multus

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

AddedInterface

Add eth0 [10.132.1.183/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

ProbeError

Startup probe error: Get "http://10.132.1.182:15021/healthz/ready": dial tcp 10.132.1.182:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

ProbeError

Startup probe error: Get "http://10.134.1.24:15021/healthz/ready": dial tcp 10.134.1.24:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

Unhealthy

Startup probe failed: Get "http://10.132.1.183:15021/healthz/ready": dial tcp 10.132.1.183:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

Unhealthy

Startup probe failed: Get "http://10.134.1.24:15021/healthz/ready": dial tcp 10.134.1.24:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

Unhealthy

Startup probe failed: Get "http://10.132.1.182:15021/healthz/ready": dial tcp 10.132.1.182:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

ProbeError

Startup probe error: Get "http://10.132.1.183:15021/healthz/ready": dial tcp 10.132.1.183:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w3-9f46e5-openshift-default-dockercfg-4djl8); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w3-9f46e5-openshift-default-dockercfg-4djl8); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-66m2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-6zqs2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-lzkcz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qkg6h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-qsd9v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w3-9f46e5-openshift-default-dockercfg-4djl8); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w3-9f46e5-openshift-default-55dbb6f54f-sgtzc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-855f9574cf-tsrbh
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-855f9574cf from 7 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tsrbh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ait-d790d69a-openshift-default-7f5f97fc65

SuccessfulCreate

Created pod: e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

openshift-ingress

deployment-controller

e2e-ait-d790d69a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d790d69a-openshift-default-7f5f97fc65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-d790d69a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d790d69a

openshift-ingress

multus

e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

AddedInterface

Add eth0 [10.132.1.184/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d790d69a-64c65cc55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d790d69a: serviceaccount "payload-processing-e2e-ait-d790d69a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d790d69a-64c65cc55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-59vp8

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d790d69a-5c7d995866

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d790d69a-5c7d995866-ppm5h
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d790d69a-5c7d995866

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d790d69a-5c7d995866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d790d69a: serviceaccount "payload-processing-e2e-ait-d790d69a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d790d69a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d790d69a-5c7d995866 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d790d69a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d790d69a-64c65cc55f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-d790d69a-5c7d995866-ppm5h

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-59vp8

AddedInterface

Add eth0 [10.132.1.187/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-d790d69a-5c7d995866-ppm5h

AddedInterface

Add eth0 [10.132.1.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-59vp8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-d790d69a-5c7d995866-ppm5h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-59vp8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-d790d69a-5c7d995866-ppm5h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-59vp8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-d790d69a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-d790d69a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

ProbeError

Startup probe error: Get "http://10.132.1.184:15021/healthz/ready": dial tcp 10.132.1.184:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

Unhealthy

Startup probe failed: Get "http://10.132.1.184:15021/healthz/ready": dial tcp 10.132.1.184:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-d790d69a-5c7d995866-ppm5h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d790d69a-64c65cc55f-59vp8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-d790d69a-openshift-default-7f5f97fc65-cdqbm

Killing

Stopping container istio-proxy

opendatahub

kubelet

maas-controller-55c765799f-2bvrd

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-55c765799f

SuccessfulDelete

Deleted pod: maas-controller-55c765799f-2bvrd

opendatahub

multus

maas-controller-55c765799f-vxzm4

AddedInterface

Add eth0 [10.132.1.188/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-55c765799f

SuccessfulCreate

Created pod: maas-controller-55c765799f-vxzm4

opendatahub

kubelet

maas-controller-55c765799f-vxzm4

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8ac03c5476dd0d483a2206237a332a7e6ee25bd74443678b4dc8ed1b938d2cc0"

opendatahub

kubelet

maas-controller-55c765799f-vxzm4

Started

Container started

opendatahub

kubelet

maas-controller-55c765799f-vxzm4

Created

Container created

opendatahub

kubelet

maas-controller-55c765799f-vxzm4

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8ac03c5476dd0d483a2206237a332a7e6ee25bd74443678b4dc8ed1b938d2cc0" in 2.243s (2.243s including waiting). Image size: 200095242 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2vf4r

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-2vf4r

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

opendatahub

maas-controller-55c765799f-vxzm4_26a6aca4-f0de-4328-bbd5-655496d5e94a

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-55c765799f-vxzm4_26a6aca4-f0de-4328-bbd5-655496d5e94a became leader

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-wtlgc
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-855f9574cf from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-x4bds

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-8gzjz
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-855f9574cf

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-855f9574cf-vkx59

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-x4bds

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-8gzjz

AddedInterface

Add eth0 [10.132.1.190/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-vkx59

AddedInterface

Add eth0 [10.132.1.192/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vkx59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vkx59

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vkx59

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-x4bds

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-x4bds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-x4bds

AddedInterface

Add eth0 [10.134.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-wtlgc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-8gzjz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-8gzjz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-wtlgc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-wtlgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-855f9574cf-wtlgc

AddedInterface

Add eth0 [10.132.1.191/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-8gzjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

maas-controller-55c765799f-vxzm4

Killing

Stopping container manager
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-55c765799f from 1 to 0

opendatahub

replicaset-controller

maas-controller-55c765799f

SuccessfulDelete

Deleted pod: maas-controller-55c765799f-vxzm4
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-55c765799f from 0 to 1

opendatahub

replicaset-controller

maas-controller-55c765799f

SuccessfulCreate

Created pod: maas-controller-55c765799f-5qgk6

opendatahub

kubelet

maas-controller-55c765799f-5qgk6

Started

Container started

opendatahub

multus

maas-controller-55c765799f-5qgk6

AddedInterface

Add eth0 [10.132.1.193/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-55c765799f-5qgk6

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8ac03c5476dd0d483a2206237a332a7e6ee25bd74443678b4dc8ed1b938d2cc0" in 457ms (457ms including waiting). Image size: 200095242 bytes.

opendatahub

kubelet

maas-controller-55c765799f-5qgk6

Created

Container created

opendatahub

kubelet

maas-controller-55c765799f-5qgk6

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8ac03c5476dd0d483a2206237a332a7e6ee25bd74443678b4dc8ed1b938d2cc0"
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-x4bds

Unhealthy

Startup probe failed: Get "http://10.134.1.26:15021/healthz/ready": dial tcp 10.134.1.26:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-x4bds

ProbeError

Startup probe error: Get "http://10.134.1.26:15021/healthz/ready": dial tcp 10.134.1.26:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-8gzjz

ProbeError

Startup probe error: Get "http://10.132.1.190:15021/healthz/ready": dial tcp 10.132.1.190:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-wtlgc

ProbeError

Startup probe error: Get "http://10.132.1.191:15021/healthz/ready": dial tcp 10.132.1.191:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-wtlgc

Unhealthy

Startup probe failed: Get "http://10.132.1.191:15021/healthz/ready": dial tcp 10.132.1.191:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-8gzjz

Unhealthy

Startup probe failed: Get "http://10.132.1.190:15021/healthz/ready": dial tcp 10.132.1.190:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vkx59

Unhealthy

Startup probe failed: Get "http://10.132.1.192:15021/healthz/ready": dial tcp 10.132.1.192:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vkx59

ProbeError

Startup probe error: Get "http://10.132.1.192:15021/healthz/ready": dial tcp 10.132.1.192:15021: connect: connection refused body:

opendatahub

maas-controller-55c765799f-5qgk6_3b075497-bcd8-4602-946c-a9a386118922

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-55c765799f-5qgk6_3b075497-bcd8-4602-946c-a9a386118922 became leader
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

Unhealthy

Readiness probe failed: Get "http://10.133.0.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-tnfsk

ProbeError

Readiness probe error: Get "http://10.133.0.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

deployment-controller

e2e-prio-pool-f44f3e5c-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-f44f3e5c-kserve-675c5859f5 from 0 to 1

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.Service llm/e2e-prio-pool-f44f3e5c-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.Deployment llm/e2e-prio-pool-f44f3e5c-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.Secret llm/e2e-prio-pool-f44f3e5c-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.ServiceAccount llm/e2e-prio-pool-f44f3e5c-epp-sa

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-f44f3e5c-epp-auth-rb

llm

replicaset-controller

e2e-prio-pool-f44f3e5c-kserve-675c5859f5

SuccessfulCreate

Created pod: e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.Role llm/e2e-prio-pool-f44f3e5c-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.RoleBinding llm/e2e-prio-pool-f44f3e5c-epp-rb

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt

Started

Container started

llm

replicaset-controller

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898

SuccessfulCreate

Created pod: e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt

Created

Container created

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.Service llm/e2e-prio-pool-f44f3e5c-epp-service

llm

deployment-controller

e2e-prio-pool-f44f3e5c-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898 from 0 to 1

llm

multus

e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt

AddedInterface

Add eth0 [10.132.1.199/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

Created v1.Deployment llm/e2e-prio-pool-f44f3e5c-kserve-router-scheduler

llm

multus

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

AddedInterface

Add eth0 [10.132.1.200/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Error

Reconciliation failed: failed to reconcile networking: failed to reconcile HTTP routes: failed to reconcile HTTPRoute llm/e2e-prio-pool-f44f3e5c-kserve-route: failed to update v1.HTTPRoute llm/e2e-prio-pool-f44f3e5c-kserve-route: Operation cannot be fulfilled on httproutes.gateway.networking.k8s.io "e2e-prio-pool-f44f3e5c-kserve-route": the object has been modified; please apply your changes to the latest version and try again

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 2.277s (2.277s including waiting). Image size: 184206420 bytes.

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

Started

Container started

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

Created

Container created

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-f44f3e5c-kserve-route
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Updated

Updated v1.Secret llm/e2e-prio-pool-f44f3e5c-kserve-self-signed-certs
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-f44f3e5c-kserve-shadow-svc

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-f44f3e5c] is Ready

llm

LLMInferenceServiceController

e2e-prio-pool-f44f3e5c

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-f44f3e5c-epp-auth-rb

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-675c5859f5-4lnmt

Unhealthy

Readiness probe failed: Get "https://10.132.1.199:8000/ready": dial tcp 10.132.1.199:8000: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-xr6ts

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-e7bf5b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-e7bf5b

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr6ts

Killing

Stopping container discovery

openshift-ingress

deployment-controller

e2e-worker-single-main-e7bf5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-e7bf5b-openshift-default-77fc5486df from 0 to 1

openshift-ingress

multus

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

AddedInterface

Add eth0 [10.134.1.30/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486df

SuccessfulCreate

Created pod: e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-e7bf5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c98756c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ww8r9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-e7bf5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-e7bf5b-785c98756c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c98756c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-e7bf5b-785c98756c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-e7bf5b: serviceaccount "payload-processing-e2e-worker-single-main-e7bf5b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74jm6r2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-e7bf5b: serviceaccount "payload-processing-e2e-worker-single-main-e7bf5b" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74jm6r2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74jm6r2

AddedInterface

Add eth0 [10.134.1.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74jm6r2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ww8r9

AddedInterface

Add eth0 [10.134.1.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74jm6r2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ww8r9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ww8r9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ww8r9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

llm

kubelet

e2e-prio-pool-f44f3e5c-kserve-router-scheduler-79b4db8898-fl6h2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

ProbeError

Startup probe error: Get "http://10.134.1.30:15021/healthz/ready": dial tcp 10.134.1.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

Unhealthy

Startup probe failed: Get "http://10.134.1.30:15021/healthz/ready": dial tcp 10.134.1.30:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-e7bf5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-e7bf5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-e7bf5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-e7bf5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ww8r9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74jm6r2

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-e7bf5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d747fkdr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c98756c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ss6hd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c98756c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-e7bf5b-785c98756c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-e7bf5b: serviceaccount "payload-processing-e2e-worker-single-main-e7bf5b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-e7bf5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-e7bf5b-785c98756c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-e7bf5b: serviceaccount "payload-processing-e2e-worker-single-main-e7bf5b" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d747fkdr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d747fkdr

AddedInterface

Add eth0 [10.132.1.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ss6hd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ss6hd

AddedInterface

Add eth0 [10.134.1.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ss6hd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d747fkdr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ss6hd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d747fkdr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-e7bf5b-f8fcc8d747fkdr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-e7bf5b-785c9ss6hd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-e7bf5b-openshift-default-77fc5486dfjfjjk

Killing

Stopping container istio-proxy

llm

deployment-controller

e2e-same-id-a-2414e1ac-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-2414e1ac-kserve-5549978c7 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Created

Created v1.DestinationRule llm/e2e-same-id-a-2414e1ac-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Created

Created v1.PodMonitor llm/e2e-same-id-a-2414e1ac-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Created

Created v1.Secret llm/e2e-same-id-a-2414e1ac-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Created

Created v1.Service llm/e2e-same-id-a-2414e1ac-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Created

Created v1.HTTPRoute llm/e2e-same-id-a-2414e1ac-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-2414e1ac-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Created

Created v1.Deployment llm/e2e-same-id-a-2414e1ac-kserve

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Created

Created v1.PodMonitor llm/e2e-same-id-a-2414e1ac-kserve-llmisvc-engine

llm

replicaset-controller

e2e-same-id-a-2414e1ac-kserve-5549978c7

SuccessfulCreate

Created pod: e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn

llm

multus

e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn

AddedInterface

Add eth0 [10.132.1.205/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn

Started

Container started

llm

kubelet

e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

Updated

Updated v1.Secret llm/e2e-same-id-a-2414e1ac-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-2414e1ac] is Ready

llm

deployment-controller

e2e-same-id-b-2414e1ac-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-2414e1ac-kserve-599dd54969 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Created

Created v1.HTTPRoute llm/e2e-same-id-b-2414e1ac-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-2414e1ac-prometheus-scraping

llm

replicaset-controller

e2e-same-id-b-2414e1ac-kserve-599dd54969

SuccessfulCreate

Created pod: e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Created

Created v1.Secret llm/e2e-same-id-b-2414e1ac-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Created

Created v1.PodMonitor llm/e2e-same-id-b-2414e1ac-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Created

Created v1.PodMonitor llm/e2e-same-id-b-2414e1ac-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Created

Created v1.Deployment llm/e2e-same-id-b-2414e1ac-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Created

Created v1.DestinationRule llm/e2e-same-id-b-2414e1ac-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Created

Created v1.Service llm/e2e-same-id-b-2414e1ac-kserve-workload-svc

llm

multus

e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47

AddedInterface

Add eth0 [10.132.1.206/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47

Created

Container created

llm

kubelet

e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

Updated

Updated v1.Secret llm/e2e-same-id-b-2414e1ac-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-2414e1ac] is Ready
(x3)

llm

LLMInferenceServiceController

e2e-same-id-a-2414e1ac

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-2414e1ac in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-2414e1ac; safe to ignore if traffic splitting is planned
(x7)

llm

LLMInferenceServiceController

e2e-same-id-b-2414e1ac

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-2414e1ac in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-2414e1ac; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47

Killing

Stopping container main
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g44hx

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-g44hx

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

e2e-same-id-a-2414e1ac-kserve-5549978c7-qdrcn

Unhealthy

Readiness probe failed: Get "https://10.132.1.205:8000/ready": dial tcp 10.132.1.205:8000: connect: connection refused

llm

kubelet

e2e-same-id-b-2414e1ac-kserve-599dd54969-zwb47

Unhealthy

Readiness probe failed: Get "https://10.132.1.206:8000/ready": EOF

openshift-ingress

replicaset-controller

payload-pre-processing-c44c86556

SuccessfulCreate

Created pod: payload-pre-processing-c44c86556-c65mk

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-c44c86556 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-c44c86556-c65mk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-c44c86556-c65mk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-c44c86556-c65mk

AddedInterface

Add eth0 [10.134.1.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-c44c86556-c65mk

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-45rfv

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-45rfv

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-9c77b64f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-9c77b64f4

SuccessfulCreate

Created pod: payload-processing-9c77b64f4-hdd5s

openshift-ingress

multus

payload-processing-9c77b64f4-hdd5s

AddedInterface

Add eth0 [10.134.1.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-9c77b64f4-hdd5s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-9c77b64f4-hdd5s

Started

Container started

openshift-ingress

kubelet

payload-processing-9c77b64f4-hdd5s

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-7bb9489676

SuccessfulDelete

Deleted pod: payload-processing-7bb9489676-x84lg

openshift-ingress

kubelet

payload-processing-7bb9489676-x84lg

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-7bb9489676 from 1 to 0

openshift-ingress

replicaset-controller

payload-pre-processing-6dc578d85f

SuccessfulCreate

Created pod: payload-pre-processing-6dc578d85f-q59ph

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-68d58ff5c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6dc578d85f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-68d58ff5c7

SuccessfulCreate

Created pod: payload-processing-68d58ff5c7-z4hlv

openshift-ingress

kubelet

payload-processing-68d58ff5c7-z4hlv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-68d58ff5c7-z4hlv

AddedInterface

Add eth0 [10.134.1.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-6dc578d85f-q59ph

Started

Container started

openshift-ingress

kubelet

payload-processing-68d58ff5c7-z4hlv

Created

Container created

openshift-ingress

kubelet

payload-processing-68d58ff5c7-z4hlv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-6dc578d85f-q59ph

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-6dc578d85f-q59ph

AddedInterface

Add eth0 [10.132.1.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-6dc578d85f-q59ph

Created

Container created

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-9c77b64f4 from 1 to 0

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-c44c86556 from 1 to 0

openshift-ingress

replicaset-controller

payload-pre-processing-c44c86556

SuccessfulDelete

Deleted pod: payload-pre-processing-c44c86556-c65mk

openshift-ingress

kubelet

payload-pre-processing-c44c86556-c65mk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-9c77b64f4-hdd5s

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-9c77b64f4

SuccessfulDelete

Deleted pod: payload-processing-9c77b64f4-hdd5s

models-as-a-service

replicaset-controller

payload-processing-external-model-7fd6967f4c

SuccessfulCreate

Created pod: payload-processing-external-model-7fd6967f4c-t5nx9
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-7fd6967f4c

FailedCreate

Error creating: pods "payload-processing-external-model-7fd6967f4c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7fd6967f4c from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-t5nx9

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-t5nx9

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-t5nx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7fd6967f4c-t5nx9

AddedInterface

Add eth0 [10.134.1.41/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-t5nx9

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-zst5d

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-zst5d

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-x4bds

Unhealthy

Readiness probe failed: Get "http://10.134.1.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-x4bds

ProbeError

Readiness probe error: Get "http://10.134.1.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vkx59

Unhealthy

Readiness probe failed: Get "http://10.132.1.192:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-vkx59

ProbeError

Readiness probe error: Get "http://10.132.1.192:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

ProbeError

Readiness probe error: Get "http://10.132.1.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-cmtzs

Unhealthy

Readiness probe failed: Get "http://10.132.1.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-single-main-4ca23e-openshift-default-55cd84869

SuccessfulCreate

Created pod: e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-4ca23e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-4ca23e

openshift-ingress

deployment-controller

e2e-worker-single-main-4ca23e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-4ca23e-openshift-default-55cd84869 from 0 to 1

openshift-ingress

multus

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

AddedInterface

Add eth0 [10.134.1.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d44

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d44

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4ca23e: serviceaccount "payload-processing-e2e-worker-single-main-4ca23e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-4ca23e-56f4978d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-4ca23e-56f4978d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4ca23e: serviceaccount "payload-processing-e2e-worker-single-main-4ca23e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-4ca23e-56f4978d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-4ca23e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-4ca23e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-4ca23e-56f4978d87 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x

AddedInterface

Add eth0 [10.134.1.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k

AddedInterface

Add eth0 [10.134.1.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

ProbeError

Startup probe error: Get "http://10.134.1.57:15021/healthz/ready": dial tcp 10.134.1.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

Unhealthy

Startup probe failed: Get "http://10.134.1.57:15021/healthz/ready": dial tcp 10.134.1.57:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-4ca23e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-4ca23e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d4b5l4k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f49qsx6x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d42w9pp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d42w9pp

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-4ca23e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d44 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-4ca23e-56f4978d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-4ca23e-56f4978d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4ca23e: serviceaccount "payload-processing-e2e-worker-single-main-4ca23e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-4ca23e-56f4978d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-4ca23e-56f497sbsf

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-4ca23e-56f497sbsf

AddedInterface

Add eth0 [10.134.1.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f497sbsf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f497sbsf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f497sbsf

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-4ca23e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-4ca23e-56f4978d87 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d44

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d42w9pp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d44

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4ca23e: serviceaccount "payload-processing-e2e-worker-single-main-4ca23e" not found

openshift-ingress

multus

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d42w9pp

AddedInterface

Add eth0 [10.134.1.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d42w9pp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4ca23e-56f497sbsf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4ca23e-54f8fc6d42w9pp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-single-main-4ca23e-openshift-default-55cd84869-5shmw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-l8fcr

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-l8fcr

Killing

Stopping container manager
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-b5brh
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-b5brh

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-b5brh

AddedInterface

Add eth0 [10.134.1.65/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-b5brh

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-b5brh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.866s (5.866s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-b5brh

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-b5brh_86bead5c-946d-4e66-9d64-0deabc8fe768

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-b5brh_86bead5c-946d-4e66-9d64-0deabc8fe768 became leader
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-wtlgc

ProbeError

Readiness probe error: Get "http://10.132.1.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-wtlgc

Unhealthy

Readiness probe failed: Get "http://10.132.1.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-8gzjz

ProbeError

Readiness probe error: Get "http://10.132.1.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-8gzjz

Unhealthy

Readiness probe failed: Get "http://10.132.1.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-mrwmt

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-mrwmt

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-5sk9w

Unhealthy

Readiness probe failed: Get "http://10.132.1.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-855f9574cf-5sk9w

ProbeError

Readiness probe error: Get "http://10.132.1.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: