Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-dhllc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-dhllc to ip-10-0-142-5.us-east-2.compute.internal

ai-tenants

e2e-api-a-db5557

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-db5557: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-f2218a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-f2218a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-1127f5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-1127f5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-18ba46

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-18ba46: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-33652a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-33652a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-400777

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-400777: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-9fbc61

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-9fbc61: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-0f6e09

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-0f6e09: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-14ebbb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-14ebbb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-37aa95

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-37aa95: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-d8d0fa

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-d8d0fa: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-db5198

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-db5198: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-dce009

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-dce009: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-03c633

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-03c633: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-05473b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-05473b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-421604

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-421604: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-6350b9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-6350b9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-c7aecb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-c7aecb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-3d4fe2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-3d4fe2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-4d63cd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-4d63cd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-745c52

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-745c52: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-8c6934

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-8c6934: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-bf7965

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-bf7965: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-519a78

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-519a78: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-5ecee8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-5ecee8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-c94fdf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-c94fdf: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-d7c7fd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-d7c7fd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-f5afd7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-f5afd7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-1b7b5e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-1b7b5e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-2eee8c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-2eee8c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-6b9849

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-6b9849: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-bf9b0a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-bf9b0a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-1142fd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-1142fd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-b07e26

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-b07e26: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-d6789f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-d6789f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-efba68

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-efba68: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-9b65143e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-9b65143e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-f3a4c29a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-f3a4c29a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-019ef4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-019ef4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-3211a0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-3211a0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-3f36ae

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-3f36ae: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-82c116

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-82c116: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-a596f7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-a596f7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-1b646f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-1b646f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-59bc3b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-59bc3b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-6bd876

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-6bd876: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-9e5029

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-9e5029: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-c4f356

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-c4f356: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-ba89e0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-ba89e0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-7a92d4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-7a92d4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-63fde4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-63fde4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-bab2c3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-bab2c3: MaasTenantConfig is not available to restore revocation operands

opendatahub

test-curl-7564-e4c772

Scheduled

Successfully assigned opendatahub/test-curl-7564-e4c772 to ip-10-0-143-81.us-east-2.compute.internal

ai-tenants

e2e-shared-b-w0-99a8fe

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-99a8fe: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-08a7bc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-08a7bc: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-3bcc2b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-3bcc2b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-6e5139

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-6e5139: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-30e9de

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-30e9de: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-f3631f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-f3631f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-b13a14

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-b13a14: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-085566

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-085566: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-4f93d1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-4f93d1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-466f83

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-466f83: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-4vrwb

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-4vrwb to ip-10-0-142-5.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-lf6j5

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-lf6j5 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-hl29q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-hl29q to ip-10-0-142-5.us-east-2.compute.internal

opendatahub

test-curl-7573-d81fc0

Scheduled

Successfully assigned opendatahub/test-curl-7573-d81fc0 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-khzkt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-khzkt to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-m6r7p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-m6r7p to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-4bbvd

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-4bbvd to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

test-curl-7573-5618ac

Scheduled

Successfully assigned opendatahub/test-curl-7573-5618ac to ip-10-0-143-81.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-n8njg

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-n8njg to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-x8ffs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ffs to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-x96lq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x96lq to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

test-curl-7570-ddf4b9

Scheduled

Successfully assigned opendatahub/test-curl-7570-ddf4b9 to ip-10-0-143-81.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8865cc5f6-5trll

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8865cc5f6-5trll to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-j86hv to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-5bgqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-5bgqc to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

test-curl-7570-1a30a2

Scheduled

Successfully assigned opendatahub/test-curl-7570-1a30a2 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-vs2wv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-vs2wv to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6 to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

test-curl-7567-e20206

Scheduled

Successfully assigned opendatahub/test-curl-7567-e20206 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn to ip-10-0-142-5.us-east-2.compute.internal

opendatahub

test-curl-7567-b0ef96

Scheduled

Successfully assigned opendatahub/test-curl-7567-b0ef96 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78 to ip-10-0-143-48.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-n49pr

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-n49pr to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-6qbwg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-6qbwg to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-mvc69 to ip-10-0-142-5.us-east-2.compute.internal

opendatahub

test-curl-7567-a8e60d

Scheduled

Successfully assigned opendatahub/test-curl-7567-a8e60d to ip-10-0-143-81.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8865cc5f6-6mcwq to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-f5gbf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-f5gbf to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

test-curl-7567-829b9a

Scheduled

Successfully assigned opendatahub/test-curl-7567-829b9a to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-9b65143e-765c4447d-vns59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9b65143e-765c4447d-vns59 to ip-10-0-143-81.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-h5gbv

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-h5gbv to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9 to ip-10-0-142-5.us-east-2.compute.internal

opendatahub

test-curl-7567-3041f7

Scheduled

Successfully assigned opendatahub/test-curl-7567-3041f7 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-j9gl6 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-lgfn7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-lgfn7 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7 to ip-10-0-143-81.us-east-2.compute.internal

ai-tenants

e2e-shared-a-w4-3c25bf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-3c25bf: MaasTenantConfig is not available to restore revocation operands

kuadrant-system

authorino-6889cbd8c4-2jvfj

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-2jvfj to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-459ca04a-59f8df6c94-szkg8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-459ca04a-59f8df6c94-szkg8 to ip-10-0-142-5.us-east-2.compute.internal

ai-tenants

e2e-api-a-98148a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-98148a: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-processing-e2e-mt-f3a4c29a-846f96f786-f546k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f3a4c29a-846f96f786-f546k to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-019ef4-68fc7d79d-h48b5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-019ef4-68fc7d79d-h48b5 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-efba68-69596d49cd-c72m5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-efba68-69596d49cd-c72m5 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-9a9ea9-5d69fc846b-7bfhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9a9ea9-5d69fc846b-7bfhk to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6 to ip-10-0-143-81.us-east-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-w94ts

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-w94ts to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h to ip-10-0-143-81.us-east-2.compute.internal

kuadrant-system

authorino-7cfb485dff-mjxfv

Scheduled

Successfully assigned kuadrant-system/authorino-7cfb485dff-mjxfv to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-98148a-7f86c6bb8d-hnn6l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-98148a-7f86c6bb8d-hnn6l to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-594f764c95-g9xdm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-594f764c95-g9xdm to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr to ip-10-0-142-5.us-east-2.compute.internal

kuadrant-system

authorino-7f8b96f5f6-jjp75

Scheduled

Successfully assigned kuadrant-system/authorino-7f8b96f5f6-jjp75 to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

test-curl-7564-7616a6

Scheduled

Successfully assigned opendatahub/test-curl-7564-7616a6 to ip-10-0-143-81.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8865cc5f6-fgw8n to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-99ntv

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-99ntv to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-8lzxb

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-8lzxb to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-s56vz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-s56vz to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-kt456

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-kt456 to ip-10-0-143-81.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-bx9l8

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-bx9l8 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-88znp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-88znp to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-h8zwm to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-kdtdl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-kdtdl to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

maas-controller-687b69bd9-q5zvz

Scheduled

Successfully assigned opendatahub/maas-controller-687b69bd9-q5zvz to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-dh4jg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-dh4jg to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

maas-controller-687b69bd9-hmtjv

Scheduled

Successfully assigned opendatahub/maas-controller-687b69bd9-hmtjv to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-c7aecb-5974bf759b-ggb9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-c7aecb-5974bf759b-ggb9m to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-76f56c5945zkwwr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945zkwwr to ip-10-0-143-81.us-east-2.compute.internal

opendatahub

maas-controller-687b69bd9-6n6dr

Scheduled

Successfully assigned opendatahub/maas-controller-687b69bd9-6n6dr to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4deb62c4-openshift-default-794b645577-9plzn to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-5556d898cf-4gn6l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-5556d898cf-4gn6l to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-d6789f-84db6df874-vqsnm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d6789f-84db6df874-vqsnm to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-7rjf5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-7rjf5 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm to ip-10-0-143-48.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-jgwq4

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-jgwq4 to ip-10-0-143-81.us-east-2.compute.internal

opendatahub

maas-controller-5d77cc995-4992w

Scheduled

Successfully assigned opendatahub/maas-controller-5d77cc995-4992w to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-3c25bf-664f9598-fzb5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-3c25bf-664f9598-fzb5f to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-jbqn5 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-nxgfd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-nxgfd to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-api-a-98148a-openshift-default-fbb48db79-cd564

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-98148a-openshift-default-fbb48db79-cd564 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-kgcck

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-kgcck to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-k6ntj to ip-10-0-143-81.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-sz7qp

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-sz7qp to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-03c633-bf68b8f86-2bgg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-03c633-bf68b8f86-2bgg6 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln to ip-10-0-143-48.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-jb45k

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-jb45k to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-9pwj7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9pwj7 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-djgdm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5 to ip-10-0-143-48.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-q5w7x

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-q5w7x to ip-10-0-143-81.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-ncvvt

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-ncvvt to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-kw7bs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-kw7bs to ip-10-0-143-48.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-9p95v

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-9p95v to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-efba68-75766bf75-sxn6f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-efba68-75766bf75-sxn6f to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-99f95578b-gg9x5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-99f95578b-gg9x5 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-c26g9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-c26g9 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-3f36ae-f89b78796-vtwt6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-3f36ae-f89b78796-vtwt6 to ip-10-0-143-48.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-k4psh

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-k4psh to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-dce009-5fbcf89498-c29n4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-dce009-5fbcf89498-c29n4 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t to ip-10-0-142-5.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-2725f

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-2725f to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-lkjxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-lkjxh to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-r8rrz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-r8rrz to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8 to ip-10-0-143-48.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-4xv5z

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-4xv5z to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-db5198-666565cf58-659tp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-db5198-666565cf58-659tp to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-b6km9 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225 to ip-10-0-143-81.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-q9gdw

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-q9gdw to ip-10-0-143-81.us-east-2.compute.internal

opendatahub

ai-gateway-controller-69ff9b4cb6-z65tg

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-69ff9b4cb6-z65tg to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-r628m to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-hvfxj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-hvfxj to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-9kx67 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-57dd5dc5bc-7z6kd

Scheduled

Successfully assigned openshift-ingress/payload-processing-57dd5dc5bc-7z6kd to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm to ip-10-0-143-81.us-east-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-h946s

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-h946s to ip-10-0-143-81.us-east-2.compute.internal

opendatahub

ai-gateway-controller-5d8dddb676-hjjmx

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5d8dddb676-hjjmx to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-7bb9489676-xx9xb

Scheduled

Successfully assigned openshift-ingress/payload-processing-7bb9489676-xx9xb to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gqpt8 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877ccj5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-d9b592-5f5dfc877ccj5v to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-05473b-7ff86fff6-wtw2t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-05473b-7ff86fff6-wtw2t to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-594f764c95-z8fjv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-594f764c95-z8fjv to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-9mjnk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-9mjnk to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-dtftr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-dtftr to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-db5557-ffc78867d-sggqh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-db5557-ffc78867d-sggqh to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-929nt to ip-10-0-142-5.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-f97c54-llkmp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-f97c54-llkmp to ip-10-0-143-48.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-b07e26-79f5c4967d-q8fdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b07e26-79f5c4967d-q8fdn to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-r8sxm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-r8sxm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-gpvg8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-gpvg8 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-7wgtr to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-b07e26-667f9bbb68-rb9v7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b07e26-667f9bbb68-rb9v7 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-1142fd-7fd577747d-x9fvm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1142fd-7fd577747d-x9fvm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-9dd42e13-fc54468c-wbg5l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9dd42e13-fc54468c-wbg5l to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-4bzqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-4bzqw to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7 to ip-10-0-143-81.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-8d2rc

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-8d2rc to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-82c116-747858446-4c54z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-82c116-747858446-4c54z to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-2cffl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-2cffl to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-w9chd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-w9chd to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-f2218a-669947bdf4-4hqc5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f2218a-669947bdf4-4hqc5 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-zqrq7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-zqrq7 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-rjzt5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-rjzt5 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-6b9849-866bfd4988-rqp4c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6b9849-866bfd4988-rqp4c to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-wnsb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-wnsb5 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb to ip-10-0-143-48.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-lr7kb

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-lr7kb to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-7cd79c685f-znwwt

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-znwwt to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-2eee8c-5f66985b86-868h2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2eee8c-5f66985b86-868h2 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-2eee8c-5bb486f988-vrdks

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2eee8c-5bb486f988-vrdks to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-db5557-66df8bbf95-fqrzl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-db5557-66df8bbf95-fqrzl to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-dqp4k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-dqp4k to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv to ip-10-0-143-48.us-east-2.compute.internal

llm

e2e-external-token-limit-simulated-kserve-65fc98cd9c-2qdw8

Scheduled

Successfully assigned llm/e2e-external-token-limit-simulated-kserve-65fc98cd9c-2qdw8 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-18ba46-7b79f64d5b-tvsg9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-18ba46-7b79f64d5b-tvsg9 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-sj8kj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-sj8kj to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-33652a-854c8bd4b8-g2cb5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-33652a-854c8bd4b8-g2cb5 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-400777-776c774778-4mwtz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-400777-776c774778-4mwtz to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-cd5ll to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f2218a-55d586c86c-svk82

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f2218a-55d586c86c-svk82 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc to ip-10-0-143-81.us-east-2.compute.internal

llm

e2e-prio-pool-0704dddb-kserve-8b5c668dd-pmbhz

Scheduled

Successfully assigned llm/e2e-prio-pool-0704dddb-kserve-8b5c668dd-pmbhz to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-9q8z2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-9q8z2 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-59bc3b-6f849ff658-8gvkb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-59bc3b-6f849ff658-8gvkb to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-e17fc195-5fdc496f48-j7dgh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e17fc195-5fdc496f48-j7dgh to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x to ip-10-0-143-81.us-east-2.compute.internal

llm

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

Scheduled

Successfully assigned llm/e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-29plj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-29plj to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-bnt6k to ip-10-0-143-48.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-9dbdc456b-mjdh6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-9dbdc456b-mjdh6 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl to ip-10-0-143-48.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-9dbdc456b-gcg5p

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-9dbdc456b-gcg5p to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-debeb1-85975f44fghb8m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-debeb1-85975f44fghb8m to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-debeb1-85975f44fl4wb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-debeb1-85975f44fl4wb4 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-nmljn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-nmljn to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-x8f4f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-x8f4f to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-ksr77

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-ksr77 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-nj4bc to ip-10-0-143-81.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-7fd6967f4c-gwsc4

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7fd6967f4c-gwsc4 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-pt86g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-pt86g to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm to ip-10-0-142-5.us-east-2.compute.internal

llm

e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv

Scheduled

Successfully assigned llm/e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-b13a14-6bb746df8d-fps9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-b13a14-6bb746df8d-fps9m to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-v98g9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-v98g9 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29 to ip-10-0-142-5.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-nmpj5

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-nmpj5 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-6bd876-5464b6d8d-ds4b8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-6bd876-5464b6d8d-ds4b8 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-l86cc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-l86cc to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-debeb1-74694f98m5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-debeb1-74694f98m5 to ip-10-0-142-5.us-east-2.compute.internal

ai-tenants

e2e-api-a-9a9ea9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-9a9ea9: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-worker-single-main-debeb1-74694c9ldp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-debeb1-74694c9ldp to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-qf9ww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-qf9ww to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-18ba46-5fb596f495-7c6dw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-18ba46-5fb596f495-7c6dw to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8 to ip-10-0-143-81.us-east-2.compute.internal

llm

e2e-same-id-a-29948937

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-29948937

llm

e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc

Scheduled

Successfully assigned llm/e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9tkwmg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-d9b592-68fc9tkwmg to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9 to ip-10-0-143-48.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-5d6ff584d8-t2p2m

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-5d6ff584d8-t2p2m to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5 to ip-10-0-143-81.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6999b5c985-7x7wf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6999b5c985-7x7wf to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-ngkfj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-ngkfj to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8 to ip-10-0-143-81.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6cfb9f578f-8m4nb

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6cfb9f578f-8m4nb to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-qq2td

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-qq2td to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-6350b9-5c98f9f596-58rw6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-6350b9-5c98f9f596-58rw6 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-085566-64777db978-9bjqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-085566-64777db978-9bjqt to ip-10-0-142-5.us-east-2.compute.internal

llm

e2e-same-id-b-29948937

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-29948937

llm

e2e-same-id-b-29948937

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-8rqcl

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-8rqcl to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-9fbc61-5c7c56cb6-74fcg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-9fbc61-5c7c56cb6-74fcg to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-mhrbz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-mhrbz to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-2f29441c-68679b869d-kd68l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2f29441c-68679b869d-kd68l to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-9e5029-7df69b99fd-4qsmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-9e5029-7df69b99fd-4qsmw to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-400777-7db698cc79-nshlh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-400777-7db698cc79-nshlh to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-9dd42e13-6df76474f8-xjlth

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9dd42e13-6df76474f8-xjlth to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-4deb62c4-57bbb6f6db-jxhx6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4deb62c4-57bbb6f6db-jxhx6 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-c4f356-65984ccdd8-8sssn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-c4f356-65984ccdd8-8sssn to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7 to ip-10-0-143-48.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-c6zd9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-c6zd9 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-btlkq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-btlkq to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-w9rlb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-w9rlb to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-5t8r4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-5t8r4 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-bxg6s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-bxg6s to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk to ip-10-0-143-81.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-cjklg

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-cjklg to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-gjhzn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-gjhzn to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-efba68-openshift-default-754b857845-ctf58 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-gtfqs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-gtfqs to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-0f6e09-7dcfd6f794-zwx5q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-0f6e09-7dcfd6f794-zwx5q to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-s9rdw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-s9rdw to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq to ip-10-0-143-81.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-4m2zs

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-4m2zs to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-mh944

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-mh944 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

Scheduled

Successfully assigned openshift-ingress/e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-4bd752fd-77b8585f66-jxtsm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4bd752fd-77b8585f66-jxtsm to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-7dc89df4c4-hhqqf

Scheduled

Successfully assigned openshift-ingress/payload-processing-7dc89df4c4-hhqqf to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-f5chr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-f5chr to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

Scheduled

Successfully assigned openshift-ingress/e2e-autores-9fbc61-openshift-default-55d484c997-n46jz to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-54r28

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-54r28 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

Scheduled

Successfully assigned openshift-ingress/e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-6xlsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-6xlsp to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-9fbc61-openshift-default-55d484c997-65cfr to ip-10-0-143-48.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-nt27p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-nt27p to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-dwwdc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-dwwdc to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-9b65143e-765c4447d-lk6s8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9b65143e-765c4447d-lk6s8 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-api-b-400777-openshift-default-845498b657-kg7b2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-400777-openshift-default-845498b657-kg7b2 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-lvs8q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-lvs8q to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-ghl9k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-ghl9k to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-519a78-f84b65d4-dqlbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-519a78-f84b65d4-dqlbq to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-bf7965-548c4c7466-mmstj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-bf7965-548c4c7466-mmstj to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-745c52-5fc5bbf548-gcdzj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-745c52-5fc5bbf548-gcdzj to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-4d63cd-6f5ccff788-zcr98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4d63cd-6f5ccff788-zcr98 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7 to ip-10-0-143-81.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-555d99b548-7jhqb

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-555d99b548-7jhqb to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

router-default-585db4bb4c-xs84v

Scheduled

Successfully assigned openshift-ingress/router-default-585db4bb4c-xs84v to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

router-default-585db4bb4c-xs84v

FailedScheduling

no nodes available to schedule pods

models-as-a-service

payload-processing-external-model-555d99b548-t5mdw

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-555d99b548-t5mdw to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

router-default-585db4bb4c-xs84v

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-m7cdp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9b65143e-7877bc9979-m7cdp to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-noten-ed5ad5-openshift-default-85499958df-jmwvv

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ed5ad5-openshift-default-85499958df-jmwvv to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-37aa95-68669fc94d-867j7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-37aa95-68669fc94d-867j7 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-546kv to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-zkr2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9b65143e-7877bc9979-zkr2h to ip-10-0-143-81.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-598bd85469-hbkd8

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-598bd85469-hbkd8 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-466f83-79cb4b6b8-5ph2j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-466f83-79cb4b6b8-5ph2j to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-18ba46-openshift-default-7848df5f9-xn679 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw to ip-10-0-143-48.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5cfccf547d-qz86j

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5cfccf547d-qz86j to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-5cpvm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-5cpvm to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-4v99j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-4v99j to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-421604-85fcf48bcb-rjhqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-421604-85fcf48bcb-rjhqj to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6bhmr to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-947bh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-947bh to ip-10-0-142-5.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6484f5959b-6ftn9

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6484f5959b-6ftn9 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-grxwv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-grxwv to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-7j9mc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-7j9mc to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5 to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-xvscb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xvscb to ip-10-0-143-81.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb to ip-10-0-143-81.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-657df65587-bkr92

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-657df65587-bkr92 to ip-10-0-142-5.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7 to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xfwgr to ip-10-0-143-48.us-east-2.compute.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-585db4bb4c from 0 to 1

openshift-ingress

replicaset-controller

router-default-585db4bb4c

SuccessfulCreate

Created pod: router-default-585db4bb4c-xs84v

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-585db4bb4c-xs84v

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-585db4bb4c-xs84v

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-585db4bb4c-xs84v

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-585db4bb4c-xs84v

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-585db4bb4c-xs84v

Created

Container created

openshift-ingress

kubelet

router-default-585db4bb4c-xs84v

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-kw7bs

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-kw7bs

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-kw7bs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-kw7bs

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-j9gl6

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-7cd79c685f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-7cd79c685f-znwwt

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-7cd79c685f from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-kw7bs

Started

Container started

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-kw7bs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.662s (5.662s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-kw7bs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-kw7bs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-7cd79c685f-znwwt

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cd79c685f-znwwt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.511s (11.511s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cd79c685f-znwwt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 15.723s (15.723s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cd79c685f-znwwt

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cd79c685f-znwwt

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-nmpj5

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-nmpj5

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-nmpj5

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-nmpj5

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-nmpj5

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.922s (3.922s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-nmpj5

Created

Container created
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-8865cc5f6 from 0 to 3

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-nmpj5_75365618-c58a-48c3-b91e-1b7dfcf0c09f became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-5trll

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8865cc5f6-5trll

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8865cc5f6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8865cc5f6-6mcwq

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8865cc5f6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8865cc5f6-5trll

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8865cc5f6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8865cc5f6-fgw8n

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.033s (3.033s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-5trll

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-5trll

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-5trll

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.83s (2.83s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Created

Container created
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

operator-lifecycle-manager

install-xlz2p

AppliedWithWarnings

2 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1, infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.045s (4.045s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-6mcwq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 420ms (420ms including waiting). Image size: 273709574 bytes.
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-5trll

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-5trll

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 443ms (443ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-8865cc5f6-6mcwq_5443bcef-6515-4536-8db0-97166b682ab5

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-8865cc5f6-6mcwq_5443bcef-6515-4536-8db0-97166b682ab5 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-5trll

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-5trll

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 413ms (413ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8865cc5f6-fgw8n

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-n8njg

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-n8njg

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-n8njg

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes
(x10)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-n8njg

Started

Container started

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-n8njg

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.453s (3.453s including waiting). Image size: 309650901 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-n8njg

Created

Container created

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-h946s

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-h946s

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-h946s

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-lf6j5

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-lf6j5

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-lf6j5

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-lf6j5

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-lf6j5

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-h946s

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.869s (2.869s including waiting). Image size: 177967631 bytes.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-h946s_39250fe3-50c9-4878-b514-88a2ac9336db

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-h946s_39250fe3-50c9-4878-b514-88a2ac9336db became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-h946s

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-h946s

Started

Container started

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-bx9l8

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1
(x10)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

authorino-operator-7b7bb4bc77-bx9l8

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-bx9l8

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-4vrwb

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-bx9l8

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-4vrwb

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-bx9l8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.958s (1.958s including waiting). Image size: 167738465 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-4vrwb

Started

Container started

kuadrant-system

authorino-operator-7b7bb4bc77-bx9l8_fe620e6a-0377-4644-81d7-9eaba73e86c2

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-bx9l8_fe620e6a-0377-4644-81d7-9eaba73e86c2 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-bx9l8

Started

Container started

cert-manager

multus

cert-manager-597b95cb84-4vrwb

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-4vrwb

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-jgwq4

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-jgwq4

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-jgwq4

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

dns-operator-controller-manager-8557cbdb84-jgwq4_d3472822-1352-4505-9579-77cec4462ace

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-jgwq4_d3472822-1352-4505-9579-77cec4462ace became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-jgwq4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.963s (1.963s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-jgwq4

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-jgwq4

Created

Container created

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-k4psh

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-k4psh

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-k4psh

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

replicaset-controller

kube-auth-proxy-594f764c95

SuccessfulCreate

Created pod: kube-auth-proxy-594f764c95-g9xdm

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-594f764c95 from 0 to 2

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-k4psh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 6.498s (6.498s including waiting). Image size: 424244516 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-76f56c5945 from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-k4psh

Created

Container created

openshift-ingress

replicaset-controller

kube-auth-proxy-594f764c95

SuccessfulCreate

Created pod: kube-auth-proxy-594f764c95-z8fjv

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-k4psh

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-76f56c5945zkwwr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-76f56c5945zkwwr

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-594f764c95-g9xdm

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-76f56c5945zkwwr

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-76f56c5945zkwwr

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-594f764c95-g9xdm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-76f56c5945

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-76f56c5945zkwwr

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-k4psh_921043fe-855d-41dd-b02d-96ba6e9e8dbd

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-k4psh_921043fe-855d-41dd-b02d-96ba6e9e8dbd became leader

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-594f764c95-z8fjv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-ingress

multus

kube-auth-proxy-594f764c95-z8fjv

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-jb45k

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-q9gdw

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4xv5z

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-4xv5z

kuadrant-system

multus

limitador-limitador-74dfcfb894-4xv5z

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-q9gdw

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-h5gbv

kuadrant-system

kubelet

authorino-57f7f8659f-h5gbv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

kube-auth-proxy-594f764c95-z8fjv

Created

Container created

kuadrant-system

multus

authorino-57f7f8659f-h5gbv

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-n49pr

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jb45k

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

openshift-ingress

kubelet

kube-auth-proxy-594f764c95-z8fjv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.495s (2.495s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-jb45k

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes
(x3)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": tls: failed to verify certificate: x509: certificate signed by unknown authority

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-594f764c95-z8fjv

Started

Container started

kuadrant-system

multus

limitador-limitador-7c9b87d574-q9gdw

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-q9gdw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.181s (1.181s including waiting). Image size: 133379307 bytes.

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

multus

authorino-56c6c9ddd5-n49pr

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-ncvvt

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ncvvt

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-ingress

kubelet

kube-auth-proxy-594f764c95-g9xdm

Started

Container started

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-ncvvt

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-594f764c95-g9xdm

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-594f764c95-g9xdm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.768s (2.768s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-q9gdw

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-q9gdw

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-n49pr

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4xv5z

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4xv5z

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4xv5z

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.51s (2.51s including waiting). Image size: 133379307 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ncvvt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.083s (2.083s including waiting). Image size: 195729000 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-h5gbv

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ncvvt

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ncvvt

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-h5gbv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.301s (2.301s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-h5gbv

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-n49pr

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-n49pr

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-n49pr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.367s (3.367s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-h5gbv

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-h5gbv

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jb45k

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jb45k

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.002s (6.002s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jb45k

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-4xv5z

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-4xv5z

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-5d6ff584d8

SuccessfulCreate

Created pod: jobset-controller-manager-5d6ff584d8-t2p2m

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-ttshg"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-5d6ff584d8 from 0 to 1

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-swjxz"

openshift-jobset-operator

kubelet

jobset-controller-manager-5d6ff584d8-t2p2m

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-5d6ff584d8-t2p2m

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-5d6ff584d8-t2p2m

Created

Container created

opendatahub

kserve-module-controller-manager-7566cf5fc8-ncvvt_ad726e30-5abb-45cb-89f4-1336fc5f31d0

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-ncvvt_ad726e30-5abb-45cb-89f4-1336fc5f31d0 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-5d6ff584d8-t2p2m

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-5d6ff584d8-t2p2m

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.167s (4.167s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

jobset-controller-manager-5d6ff584d8-t2p2m_219ea2be-1ad7-4d3b-9d4f-dd5714de0da7

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-5d6ff584d8-t2p2m_219ea2be-1ad7-4d3b-9d4f-dd5714de0da7 became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5d77cc995 from 0 to 1

opendatahub

replicaset-controller

maas-controller-5d77cc995

SuccessfulCreate

Created pod: maas-controller-5d77cc995-4992w

opendatahub

multus

maas-controller-5d77cc995-4992w

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

opendatahub

multus

maas-controller-687b69bd9-6n6dr

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5d77cc995-4992w

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:9702bbc56ba2e9645109470392d2aedc9f80832a5241a1bc0d1c556ce8c352a5"

opendatahub

replicaset-controller

maas-controller-687b69bd9

SuccessfulCreate

Created pod: maas-controller-687b69bd9-6n6dr

opendatahub

kubelet

maas-controller-687b69bd9-6n6dr

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:9702bbc56ba2e9645109470392d2aedc9f80832a5241a1bc0d1c556ce8c352a5"

opendatahub

kubelet

maas-controller-5d77cc995-4992w

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:9702bbc56ba2e9645109470392d2aedc9f80832a5241a1bc0d1c556ce8c352a5" in 4.507s (4.507s including waiting). Image size: 200095241 bytes.

opendatahub

kubelet

maas-controller-687b69bd9-6n6dr

Started

Container started

opendatahub

kubelet

maas-controller-687b69bd9-6n6dr

Created

Container created

opendatahub

kubelet

maas-controller-687b69bd9-6n6dr

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:9702bbc56ba2e9645109470392d2aedc9f80832a5241a1bc0d1c556ce8c352a5" in 4.074s (4.074s including waiting). Image size: 200095241 bytes.

opendatahub

kubelet

maas-controller-5d77cc995-4992w

Created

Container created

opendatahub

kubelet

maas-controller-5d77cc995-4992w

Started

Container started

opendatahub

maas-controller-687b69bd9-6n6dr_74063dcc-1c9d-48d8-809d-4354ea0c0041

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-687b69bd9-6n6dr_74063dcc-1c9d-48d8-809d-4354ea0c0041 became leader

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-4bbvd

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-4bbvd

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-4bbvd

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-99ntv

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-sz7qp

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-2725f

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-8lzxb

opendatahub

multus

odh-model-controller-769875db56-99ntv

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sz7qp

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

odh-model-controller-769875db56-99ntv

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9pwj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

opendatahub

multus

kserve-controller-manager-776cc66d47-2725f

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-sz7qp

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-9pwj7

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9pwj7

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-2725f

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-9pwj7

opendatahub

multus

model-serving-api-75bd89fdfc-8lzxb

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-8lzxb

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9pwj7

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9pwj7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9pwj7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-kw7bs

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-kw7bs

opendatahub

replicaset-controller

maas-controller-5d77cc995

SuccessfulDelete

Deleted pod: maas-controller-5d77cc995-4992w

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sz7qp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.495s (3.495s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

maas-controller-5d77cc995-4992w

Killing

Stopping container manager

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5d77cc995 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-8lzxb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.324s (3.324s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-2725f

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.242s (4.242s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sz7qp

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-8lzxb

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-2725f

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-8lzxb

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-2725f

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sz7qp

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-99ntv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 5.289s (5.289s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-99ntv

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-99ntv

Created

Container created

opendatahub

kserve-controller-manager-776cc66d47-2725f_7ae6fe96-ad42-4446-9224-b4555be90012

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-2725f_7ae6fe96-ad42-4446-9224-b4555be90012 became leader

opendatahub

odh-model-controller-769875db56-99ntv_50d42244-6cc1-40ef-9936-dd0599f03438

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-99ntv_50d42244-6cc1-40ef-9936-dd0599f03438 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-sz7qp_3debb8bd-e94f-43a8-81be-482f838c74ed

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-sz7qp_3debb8bd-e94f-43a8-81be-482f838c74ed became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-4bbvd

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 16.923s (16.923s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-4bbvd

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-4bbvd

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Created

Container created

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-2jvfj

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-w94ts

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-w94ts

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7f8b96f5f6 from 0 to 1

kuadrant-system

replicaset-controller

authorino-7f8b96f5f6

SuccessfulCreate

Created pod: authorino-7f8b96f5f6-jjp75
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-2jvfj

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

kubelet

authorino-6889cbd8c4-2jvfj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 762ms (762ms including waiting). Image size: 204096810 bytes.

kuadrant-system

multus

authorino-7f8b96f5f6-jjp75

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6889cbd8c4-2jvfj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6889cbd8c4-2jvfj

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-2jvfj

Started

Container started

kuadrant-system

kubelet

authorino-7f8b96f5f6-jjp75

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6889cbd8c4-2jvfj

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-7f8b96f5f6-jjp75

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-n49pr

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-n49pr

kuadrant-system

kubelet

authorino-7f8b96f5f6-jjp75

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 935ms (935ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-2jvfj

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-7f8b96f5f6-jjp75

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-q5w7x

opendatahub

multus

llmisvc-controller-manager-6466c554d8-q5w7x

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-q5w7x

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-q5w7x

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-q5w7x

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-q5w7x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 363ms (363ms including waiting). Image size: 235100981 bytes.
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sz7qp

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-sz7qp

opendatahub

llmisvc-controller-manager-6466c554d8-q5w7x_5149ab6e-c697-4db6-858b-574e9745542b

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-q5w7x_5149ab6e-c697-4db6-858b-574e9745542b became leader

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulCreate

Created pod: ai-gateway-controller-5d8dddb676-hjjmx

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5d8dddb676 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-hjjmx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-5d8dddb676-hjjmx

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-hjjmx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.72s (1.72s including waiting). Image size: 184136103 bytes.

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-hjjmx

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-hjjmx

Started

Container started

opendatahub

ai-gateway-controller-5d8dddb676-hjjmx_cbd2fece-6c57-440a-8aaf-0ac1c249dad3

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5d8dddb676-hjjmx_cbd2fece-6c57-440a-8aaf-0ac1c249dad3 became leader

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-7bb9489676

FailedCreate

Error creating: pods "payload-processing-7bb9489676-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-7bb9489676

SuccessfulCreate

Created pod: payload-processing-7bb9489676-xx9xb
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-7rjf5

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-7bb9489676 from 0 to 1

openshift-ingress

kubelet

payload-processing-7bb9489676-xx9xb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-7bb9489676-xx9xb

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-7rjf5

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-7rjf5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-7bb9489676-xx9xb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-7rjf5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.289s (2.289s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-7bb9489676-xx9xb

Created

Container created

openshift-ingress

kubelet

payload-processing-7bb9489676-xx9xb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.099s (2.099s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-7rjf5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-7rjf5

Created

Container created

opendatahub

multus

ai-gateway-controller-69ff9b4cb6-z65tg

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-69ff9b4cb6 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-69ff9b4cb6-z65tg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

replicaset-controller

ai-gateway-controller-69ff9b4cb6

SuccessfulCreate

Created pod: ai-gateway-controller-69ff9b4cb6-z65tg

opendatahub

kubelet

ai-gateway-controller-69ff9b4cb6-z65tg

Started

Container started

opendatahub

kubelet

ai-gateway-controller-69ff9b4cb6-z65tg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 415ms (415ms including waiting). Image size: 184136103 bytes.

opendatahub

kubelet

ai-gateway-controller-69ff9b4cb6-z65tg

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-hjjmx

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulDelete

Deleted pod: ai-gateway-controller-5d8dddb676-hjjmx

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-5d8dddb676 from 1 to 0

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.248s (1.248s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-8d2rc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-8d2rc

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-8d2rc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-lr7kb

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-lr7kb

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-8d2rc

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-8d2rc

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-8d2rc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.189s (1.189s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-lr7kb

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-lr7kb

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-lr7kb

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 353ms (353ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-lr7kb

Started

Container started

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.PodMonitor llm/e2e-external-token-limit-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.PodMonitor llm/e24c8173cd67cca19f868a6ecff2b3963-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.DestinationRule llm/e2e-external-token-limit-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.HTTPRoute llm/e2e-external-token-limit-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.Service llm/e2e-external-token-limit-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.NetworkPolicy llm/e2e-external-token-limit-simulated-prometheus-scraping

llm

replicaset-controller

e2e-external-token-limit-simulated-kserve-65fc98cd9c

SuccessfulCreate

Created pod: e2e-external-token-limit-simulated-kserve-65fc98cd9c-2qdw8

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.Deployment llm/e2e-external-token-limit-simulated-kserve

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.Secret llm/e2e-external-token-limit-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-external-token-limit-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-external-token-limit-simulated-kserve-65fc98cd9c from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-external-token-limit-simulated-kserve-65fc98cd9c-2qdw8

Created

Container created

llm

kubelet

e2e-external-token-limit-simulated-kserve-65fc98cd9c-2qdw8

Started

Container started

llm

kubelet

e2e-external-token-limit-simulated-kserve-65fc98cd9c-2qdw8

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-external-token-limit-simulated-kserve-65fc98cd9c-2qdw8

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

llm

kubelet

e2e-external-token-limit-simulated-kserve-65fc98cd9c-2qdw8

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 393ms (393ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-8rqcl

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-8rqcl

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-8rqcl

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-8rqcl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 352ms (352ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-8rqcl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-8rqcl

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

opendatahub

ai-gateway-controller-69ff9b4cb6-z65tg_3c74a4ec-9b0b-4884-a19e-2330069181e0

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-69ff9b4cb6-z65tg_3c74a4ec-9b0b-4884-a19e-2330069181e0 became leader

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 347ms (347ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-cjklg

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

multus

echo-simulator-kserve-64b6f8f96c-cjklg

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-cjklg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-4m2zs

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-4m2zs

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

echo-simulator-kserve-64b6f8f96c-cjklg

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-4m2zs

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-4m2zs

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-4m2zs

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 367ms (367ms including waiting). Image size: 98346788 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-cjklg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.603s (1.603s including waiting). Image size: 78208878 bytes.

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-4m2zs

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-cjklg

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 300ms (300ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-external-token-limit-simulated] is Ready

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Updated

Updated v1.Secret llm/e2e-external-token-limit-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

kuadrant-system

replicaset-controller

authorino-7cfb485dff

SuccessfulCreate

Created pod: authorino-7cfb485dff-mjxfv

kuadrant-system

kubelet

authorino-7cfb485dff-mjxfv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-7cfb485dff-mjxfv

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-7cfb485dff-mjxfv

Created

Container created

kuadrant-system

kubelet

authorino-7cfb485dff-mjxfv

Started

Container started

kuadrant-system

kubelet

authorino-7cfb485dff-mjxfv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.126s (1.126s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-7f8b96f5f6-jjp75

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-7f8b96f5f6

SuccessfulDelete

Deleted pod: authorino-7f8b96f5f6-jjp75
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-7f8b96f5f6 from 1 to 0

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-947bh

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-6bhmr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-947bh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-cd5ll

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.751s (3.751s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.662s (3.662s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.063s (4.063s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 4 to 8

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-ksr77

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-w9chd

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-qq2td

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-ksr77

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-w9chd

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-qq2td

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-jbqn5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

Started

Container started

openshift-ingress

replicaset-controller

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c

SuccessfulCreate

Created pod: e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

openshift-ingress

replicaset-controller

e2e-ait-e17fc195-openshift-default-67d5d7cc59

SuccessfulCreate

Created pod: e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

openshift-ingress

deployment-controller

e2e-migrate-459ca04a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-459ca04a-gw-openshift-default-68b84f665c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-459ca04a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-459ca04a-gw

openshift-ingress

multus

e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-9dd42e13-openshift-default-5897cdd6cc

SuccessfulCreate

Created pod: e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

openshift-ingress

gateway_labeler_controller

e2e-ait-e17fc195

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e17fc195

openshift-ingress

deployment-controller

e2e-ait-9dd42e13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9dd42e13-openshift-default-5897cdd6cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-9dd42e13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9dd42e13

openshift-ingress

multus

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-e17fc195-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e17fc195-openshift-default-67d5d7cc59 from 0 to 1
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

multus

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-4bd752fd-openshift-default-6896d84957

SuccessfulCreate

Created pod: e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-4bd752fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4bd752fd-openshift-default-6896d84957 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-4bd752fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4bd752fd

openshift-ingress

multus

e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e17fc195

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e17fc195-5fdc496f48 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-29plj

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e17fc195: serviceaccount "payload-processing-e2e-ait-e17fc195" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-459ca04a-59f8df6c94

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-459ca04a-59f8df6c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-459ca04a: serviceaccount "payload-processing-e2e-migrate-459ca04a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-459ca04a-59f8df6c94

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-459ca04a-59f8df6c94-szkg8

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-459ca04a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-459ca04a-59f8df6c94 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e17fc195

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e17fc195-5fdc496f48

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e17fc195-5fdc496f48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e17fc195: serviceaccount "payload-processing-e2e-ait-e17fc195" not found

openshift-ingress

multus

payload-processing-e2e-migrate-459ca04a-59f8df6c94-szkg8

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-29plj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-459ca04a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-459ca04a: serviceaccount "payload-processing-e2e-migrate-459ca04a" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-459ca04a-59f8df6c94-szkg8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-29plj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-459ca04a-59f8df6c94-szkg8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-459ca04a-59f8df6c94-szkg8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-29plj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-29plj

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9dd42e13-6df76474f8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9dd42e13-6df76474f8-xjlth
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9dd42e13-fc54468c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9dd42e13-fc54468c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9dd42e13: serviceaccount "payload-processing-e2e-ait-9dd42e13" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-4bzqw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-e17fc195-5fdc496f48-j7dgh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-e17fc195-5fdc496f48-j7dgh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-e17fc195-5fdc496f48-j7dgh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-e17fc195-5fdc496f48-j7dgh

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-4bzqw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9dd42e13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9dd42e13-6df76474f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-4bzqw

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-4bzqw

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9dd42e13-6df76474f8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9dd42e13-6df76474f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9dd42e13: serviceaccount "payload-processing-e2e-ait-9dd42e13" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-4bzqw

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e17fc195-5fdc496f48

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e17fc195-5fdc496f48-j7dgh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9dd42e13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9dd42e13-fc54468c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9dd42e13-fc54468c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9dd42e13-fc54468c-wbg5l

openshift-ingress

multus

payload-pre-processing-e2e-ait-9dd42e13-fc54468c-wbg5l

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4bd752fd-77b8585f66

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4bd752fd-77b8585f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4bd752fd: serviceaccount "payload-processing-e2e-ait-4bd752fd" not found

openshift-ingress

multus

payload-processing-e2e-ait-9dd42e13-6df76474f8-xjlth

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9dd42e13-fc54468c-wbg5l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9dd42e13-fc54468c-wbg5l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9dd42e13-fc54468c-wbg5l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-9dd42e13-6df76474f8-xjlth

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4bd752fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4bd752fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4bd752fd-77b8585f66 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4bd752fd-77b8585f66

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4bd752fd-77b8585f66-jxtsm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-r8sxm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4bd752fd: serviceaccount "payload-processing-e2e-ait-4bd752fd" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-9dd42e13-6df76474f8-xjlth

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-9dd42e13-6df76474f8-xjlth

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-r8sxm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-4bd752fd-77b8585f66-jxtsm

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4bd752fd-77b8585f66-jxtsm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-4bd752fd-77b8585f66-jxtsm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-4bd752fd-77b8585f66-jxtsm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-r8sxm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-r8sxm

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-r8sxm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-nj4bc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-59f957fdd7-gqpt8

openshift-ingress

gateway_labeler_controller

e2e-derive-2f29441c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2f29441c

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-derive-2f29441c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2f29441c-openshift-default-7f78d7dbdf from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

Started

Container started

openshift-ingress

replicaset-controller

e2e-derive-2f29441c-openshift-default-7f78d7dbdf

SuccessfulCreate

Created pod: e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

Created

Container created

openshift-ingress

multus

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2f29441c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-btlkq

openshift-ingress

kubelet

payload-processing-e2e-derive-2f29441c-68679b869d-kd68l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-btlkq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-2f29441c-68679b869d-kd68l

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-2f29441c-68679b869d-kd68l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-btlkq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-btlkq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2f29441c-68679b869d

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2f29441c-68679b869d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2f29441c: serviceaccount "payload-processing-e2e-derive-2f29441c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2f29441c-68679b869d

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2f29441c-68679b869d-kd68l

openshift-ingress

kubelet

payload-processing-e2e-derive-2f29441c-68679b869d-kd68l

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2f29441c: serviceaccount "payload-processing-e2e-derive-2f29441c" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-btlkq

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2f29441c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2f29441c-68679b869d from 0 to 1
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4bd752fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4bd752fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc

Started

Container started

openshift-ingress

kubelet

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-migrate-459ca04a-59f8df6c94-szkg8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-459ca04a-77bdd67bdc-29plj

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9dd42e13-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e17fc195-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-459ca04a-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-459ca04a-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9dd42e13-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e17fc195-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4bd752fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4bd752fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-migrate-459ca04a-gw-openshift-default-68b84f665c-zxrpm

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e17fc195-7c5bb5666c-4bzqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e17fc195-5fdc496f48-j7dgh

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-9dd42e13-6df76474f8-xjlth

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-4f93d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-4f93d1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9dd42e13-fc54468c-wbg5l

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-4bd752fd-77b8585f66-jxtsm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-9dd42e13-openshift-default-5897cdd6cc-w28mm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bd752fd-56bfc9f7dc-r8sxm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-4bd752fd-openshift-default-6896d84957-rwdwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-e17fc195-openshift-default-67d5d7cc59-gjtg2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-466f83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-466f83

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-085566-openshift-default-9958546fc from 0 to 1

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-085566

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-085566

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-f5gbf

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-4f93d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-f3631f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f3631f

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4f93d1: serviceaccount "payload-processing-e2e-worker-w3-4f93d1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4f93d1: serviceaccount "payload-processing-e2e-worker-w3-4f93d1" not found

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-2f29441c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-2f29441c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-7j9mc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-4f93d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c from 0 to 1

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-f5gbf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-f5gbf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-7j9mc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-7j9mc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-7j9mc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-7j9mc

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-f5gbf

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-f5gbf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-2f29441c-68679b869d-kd68l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2f29441c-5c594d8f6c-btlkq

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-466f83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947 from 0 to 1

openshift-ingress

kubelet

e2e-derive-2f29441c-openshift-default-7f78d7dbdf-xhhdp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-466f83-79cb4b6b8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-466f83-79cb4b6b8-5ph2j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-466f83-79cb4b6b8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-466f83-79cb4b6b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-466f83: serviceaccount "payload-processing-e2e-worker-w4-466f83" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-m6r7p
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-466f83: serviceaccount "payload-processing-e2e-worker-w4-466f83" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-466f83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-466f83-79cb4b6b8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-m6r7p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-m6r7p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-466f83-79cb4b6b8-5ph2j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-466f83-79cb4b6b8-5ph2j

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-m6r7p

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-466f83-79cb4b6b8-5ph2j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-466f83-79cb4b6b8-5ph2j

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-m6r7p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f3631f-5bc8d4db88

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-nmljn

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-nmljn

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-f3631f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-f3631f-5bc8d4db88 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-l86cc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-l86cc

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f3631f: serviceaccount "payload-processing-e2e-worker-w0-f3631f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-l86cc

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f3631f-5bc8d4db88

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f3631f: serviceaccount "payload-processing-e2e-worker-w0-f3631f" not found

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-f3631f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-l86cc

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-nmljn

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-l86cc

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-nmljn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-b13a14

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-b13a14

openshift-ingress

multus

payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-nmljn

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-dwwdc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-085566

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-085566-64777db978

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-085566-64777db978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-085566: serviceaccount "payload-processing-e2e-worker-w2-085566" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-085566-64777db978

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-085566-64777db978-9bjqt

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-dwwdc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-dwwdc

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w2-085566-64777db978-9bjqt

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-085566: serviceaccount "payload-processing-e2e-worker-w2-085566" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-085566-64777db978-9bjqt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-085566

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-085566-64777db978 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-dwwdc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-085566-64777db978-9bjqt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-085566-64777db978-9bjqt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-dwwdc

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-b13a14

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-b13a14-6bb746df8d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-qf9ww

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b13a14-6bb746df8d-fps9m

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w1-b13a14-6bb746df8d-fps9m

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-qf9ww

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-qf9ww

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b13a14-6bb746df8d-fps9m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-b13a14

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-qf9ww

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-b13a14-6bb746df8d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-b13a14-6bb746df8d-fps9m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-b13a14-6bb746df8d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-b13a14-6bb746df8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b13a14: serviceaccount "payload-processing-e2e-worker-w1-b13a14" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b13a14: serviceaccount "payload-processing-e2e-worker-w1-b13a14" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-qf9ww

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b13a14-6bb746df8d-fps9m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-x96lq
(x2)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x96lq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-x96lq

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x96lq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.75s (5.75s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x96lq

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x96lq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 1 to 2

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-085566-openshift-default-9958546fc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

Started

Container started

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

Started

Container started

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 1 to 2
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-f97c54

FailedCreate

Error creating: pods "payload-processing-external-model-f97c54-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-f97c54 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-f97c54

SuccessfulCreate

Created pod: payload-processing-external-model-f97c54-llkmp

models-as-a-service

kubelet

payload-processing-external-model-f97c54-llkmp

Started

Container started

models-as-a-service

multus

payload-processing-external-model-f97c54-llkmp

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-f97c54-llkmp

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-f97c54-llkmp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6999b5c985 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-6999b5c985

SuccessfulCreate

Created pod: payload-processing-external-model-6999b5c985-7x7wf

models-as-a-service

kubelet

payload-processing-external-model-6999b5c985-7x7wf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6999b5c985-7x7wf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6999b5c985-7x7wf

Created

Container created

models-as-a-service

multus

payload-processing-external-model-6999b5c985-7x7wf

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-f97c54-llkmp

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 2 to 4

models-as-a-service

replicaset-controller

payload-processing-external-model-f97c54

SuccessfulDelete

Deleted pod: payload-processing-external-model-f97c54-llkmp

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-f97c54 from 1 to 0

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

Created

Container created

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-9dbdc456b

SuccessfulCreate

Created pod: payload-processing-external-model-9dbdc456b-gcg5p

models-as-a-service

multus

payload-processing-external-model-9dbdc456b-gcg5p

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-9dbdc456b-gcg5p

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-9dbdc456b-gcg5p

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-9dbdc456b-gcg5p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-6999b5c985

SuccessfulDelete

Deleted pod: payload-processing-external-model-6999b5c985-7x7wf

models-as-a-service

kubelet

payload-processing-external-model-6999b5c985-7x7wf

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6999b5c985 from 1 to 0

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

models-as-a-service

replicaset-controller

payload-processing-external-model-5cfccf547d

SuccessfulCreate

Created pod: payload-processing-external-model-5cfccf547d-qz86j

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5cfccf547d from 0 to 1

models-as-a-service

multus

payload-processing-external-model-5cfccf547d-qz86j

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5cfccf547d-qz86j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5cfccf547d-qz86j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

Created

Container created

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5cfccf547d-qz86j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 5; reason:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24
(x3)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 4 to 5

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-9dbdc456b from 1 to 0

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-9dbdc456b

SuccessfulDelete

Deleted pod: payload-processing-external-model-9dbdc456b-gcg5p

models-as-a-service

kubelet

payload-processing-external-model-9dbdc456b-gcg5p

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Unhealthy

Liveness probe failed: Get "https://10.133.0.38:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

Created

Container created

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

Created

Container created

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-9dbdc456b from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-9dbdc456b-mjdh6

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-9dbdc456b

SuccessfulCreate

Created pod: payload-processing-external-model-9dbdc456b-mjdh6

models-as-a-service

multus

payload-processing-external-model-9dbdc456b-mjdh6

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-9dbdc456b-mjdh6

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-9dbdc456b-mjdh6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

Started

Container started

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

Created

Container created

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

Started

Container started

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-9dbdc456b-mjdh6

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5cfccf547d from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-5cfccf547d-qz86j

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-5cfccf547d

SuccessfulDelete

Deleted pod: payload-processing-external-model-5cfccf547d-qz86j

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 5 to 9

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bg4kj

Unhealthy

Readiness probe failed: Get "https://10.134.0.32:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-db5557

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-db5557

openshift-ingress

deployment-controller

e2e-api-a-db5557-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-db5557-openshift-default-7b85fc7bbf from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-db5557-openshift-default-7b85fc7bbf

SuccessfulCreate

Created pod: e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

openshift-ingress

multus

e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-db5557-ffc78867d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-db5557-ffc78867d-sggqh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-db5557-ffc78867d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-db5557-ffc78867d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-db5557: serviceaccount "payload-processing-e2e-api-a-db5557" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-db5557-66df8bbf95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-db5557-66df8bbf95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-db5557: serviceaccount "payload-processing-e2e-api-a-db5557" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-db5557-66df8bbf95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-db5557-66df8bbf95-fqrzl

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-db5557

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-db5557-ffc78867d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-db5557

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-db5557-66df8bbf95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-db5557-66df8bbf95-fqrzl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-db5557-ffc78867d-sggqh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-db5557-ffc78867d-sggqh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-db5557-66df8bbf95-fqrzl

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-db5557-ffc78867d-sggqh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-db5557-66df8bbf95-fqrzl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-db5557-ffc78867d-sggqh

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-db5557-66df8bbf95-fqrzl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Unhealthy

Readiness probe failed: Get "https://10.133.0.38:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

Started

Container started
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x7)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-18ba46

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-18ba46

openshift-ingress

deployment-controller

e2e-api-b-18ba46-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-18ba46-openshift-default-7848df5f9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-18ba46-openshift-default-7848df5f9

SuccessfulCreate

Created pod: e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

openshift-ingress

multus

e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

Created

Container created

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-18ba46-5fb596f495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-18ba46-5fb596f495-7c6dw

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-18ba46-7b79f64d5b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-18ba46-7b79f64d5b-tvsg9

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-18ba46

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-18ba46-7b79f64d5b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-18ba46-7b79f64d5b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-18ba46-7b79f64d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-18ba46: serviceaccount "payload-processing-e2e-api-b-18ba46" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-18ba46

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-18ba46-5fb596f495 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-18ba46-5fb596f495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-18ba46-5fb596f495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-18ba46: serviceaccount "payload-processing-e2e-api-b-18ba46" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-18ba46-7b79f64d5b-tvsg9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-18ba46-5fb596f495-7c6dw

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-18ba46-5fb596f495-7c6dw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-18ba46-7b79f64d5b-tvsg9

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-18ba46-5fb596f495-7c6dw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-18ba46-5fb596f495-7c6dw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-18ba46-7b79f64d5b-tvsg9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-18ba46-7b79f64d5b-tvsg9

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-085566-openshift-default-9958546fc from 4 to 5
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-db5557-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-db5557-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 8 to 10

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

ProbeError

Startup probe error: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

Unhealthy

Startup probe failed: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-9b65143e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9b65143e-openshift-default-5ddf6c8dd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9

SuccessfulCreate

Created pod: e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

openshift-ingress

gateway_labeler_controller

e2e-mt-9b65143e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9b65143e

openshift-ingress

multus

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9b65143e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9b65143e-7877bc9979 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9b65143e-765c4447d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9b65143e-765c4447d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9b65143e: serviceaccount "payload-processing-e2e-mt-9b65143e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9b65143e-7877bc9979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9b65143e-7877bc9979-m7cdp
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9b65143e-7877bc9979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9b65143e-7877bc9979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9b65143e: serviceaccount "payload-processing-e2e-mt-9b65143e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9b65143e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9b65143e-765c4447d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9b65143e-765c4447d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9b65143e-765c4447d-lk6s8

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-m7cdp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-9b65143e-765c4447d-lk6s8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-m7cdp

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-9b65143e-765c4447d-lk6s8

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-m7cdp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-9b65143e-765c4447d-lk6s8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-m7cdp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-9b65143e-765c4447d-lk6s8

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-18ba46-openshift-default-7848df5f9

SuccessfulCreate

Created pod: e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

openshift-ingress

deployment-controller

e2e-api-b-18ba46-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-18ba46-openshift-default-7848df5f9 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-18ba46-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-b-18ba46-openshift-default-7848df5f9

SuccessfulCreate

Created pod: e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

openshift-ingress

replicaset-controller

e2e-api-b-18ba46-openshift-default-7848df5f9

SuccessfulCreate

Created pod: e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

Created

Container created

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

Started

Container started

openshift-ingress

multus

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

Started

Container started

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

Created

Container created

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

Started

Container started

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

Created

Container created

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-a-98148a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-98148a

openshift-ingress

deployment-controller

e2e-api-a-98148a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-98148a-openshift-default-fbb48db79 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-98148a-openshift-default-fbb48db79

SuccessfulCreate

Created pod: e2e-api-a-98148a-openshift-default-fbb48db79-cd564

openshift-ingress

multus

e2e-api-a-98148a-openshift-default-fbb48db79-cd564

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

Unhealthy

Startup probe failed: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

ProbeError

Startup probe error: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-db5557-66df8bbf95-fqrzl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-db5557-ffc78867d-sggqh

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-98148a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-98148a-7f86c6bb8d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-98148a-5b479ccd4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-98148a: serviceaccount "payload-processing-e2e-api-a-98148a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-98148a-7f86c6bb8d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-98148a-7f86c6bb8d-hnn6l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-98148a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-98148a-5b479ccd4c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-98148a-7f86c6bb8d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-98148a-7f86c6bb8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-98148a: serviceaccount "payload-processing-e2e-api-a-98148a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-98148a-5b479ccd4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-dhllc

openshift-ingress

kubelet

payload-processing-e2e-api-a-98148a-7f86c6bb8d-hnn6l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-dhllc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-dhllc

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-98148a-7f86c6bb8d-hnn6l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-dhllc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-dhllc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-98148a-7f86c6bb8d-hnn6l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-98148a-7f86c6bb8d-hnn6l

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-db5557-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-18ba46-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-18ba46-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-db5557-openshift-default-7b85fc7bbf-w8xtl

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-db5557-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-kgcck

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-kgcck

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kgcck

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

payload-processing-e2e-api-b-18ba46-7b79f64d5b-tvsg9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-18ba46-5fb596f495-7c6dw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kgcck

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.424s (4.424s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kgcck

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kgcck

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kgcck

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kgcck

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

ProbeError

Readiness probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

Unhealthy

Readiness probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-33652a-openshift-default-5ff86849f9

SuccessfulCreate

Created pod: e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

openshift-ingress

replicaset-controller

e2e-api-b-18ba46-openshift-default-7848df5f9

SuccessfulCreate

Created pod: e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

openshift-ingress

replicaset-controller

e2e-api-b-18ba46-openshift-default-7848df5f9

SuccessfulCreate

Created pod: e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

openshift-ingress

replicaset-controller

e2e-api-b-18ba46-openshift-default-7848df5f9

SuccessfulCreate

Created pod: e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

openshift-ingress

gateway_labeler_controller

e2e-api-b-33652a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-33652a

openshift-ingress

deployment-controller

e2e-api-b-33652a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-33652a-openshift-default-5ff86849f9 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-18ba46-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-api-b-18ba46-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-18ba46-openshift-default-7848df5f9 from 4 to 8

openshift-ingress

replicaset-controller

e2e-api-b-18ba46-openshift-default-7848df5f9

SuccessfulCreate

Created pod: e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

openshift-ingress

multus

e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

Created

Container created

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

Started

Container started

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

Started

Container started

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

Created

Container created

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

Started

Container started

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

Started

Container started

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

Created

Container created

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

Created

Container created

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-18ba46-openshift-default-dockercfg-zvvnj); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-cgknk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-18ba46-openshift-default-dockercfg-zvvnj); attempting to pull the image may not succeed.
(x3)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-18ba46-openshift-default-dockercfg-zvvnj); attempting to pull the image may not succeed.
(x2)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-18ba46-openshift-default-dockercfg-zvvnj); attempting to pull the image may not succeed.
(x2)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

ProbeError

Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

ProbeError

Startup probe error: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-4nfjl

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

Unhealthy

Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

Unhealthy

Startup probe failed: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-mqgx6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-33652a-7f5ffd9679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-mhrbz

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-fzdh8

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-98148a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-98148a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-33652a-854c8bd4b8

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-33652a-854c8bd4b8-g2cb5

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-8gb9x

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-33652a-854c8bd4b8

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-33652a-854c8bd4b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-33652a: serviceaccount "payload-processing-e2e-api-b-33652a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-33652a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-33652a-7f5ffd9679 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-33652a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-33652a-854c8bd4b8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-33652a-7f5ffd9679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-33652a: serviceaccount "payload-processing-e2e-api-b-33652a" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-33652a-854c8bd4b8-g2cb5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-mhrbz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-mhrbz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-mhrbz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-33652a-854c8bd4b8-g2cb5

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-33652a-854c8bd4b8-g2cb5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-33652a-854c8bd4b8-g2cb5

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-mhrbz

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

ProbeError

Readiness probe error: Get "http://10.134.0.89:15021/healthz/ready": read tcp 10.134.0.2:38170->10.134.0.89:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

Unhealthy

Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-xn679

ProbeError

Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-d2tp5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-18ba46-openshift-default-7848df5f9-69qg4

Unhealthy

Readiness probe failed: Get "http://10.134.0.89:15021/healthz/ready": read tcp 10.134.0.2:38170->10.134.0.89:15021: read: connection reset by peer

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-085566-openshift-default-9958546fc from 5 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-929nt

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-9b65143e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-9b65143e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-085566-openshift-default-9958546fc from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-98148a-openshift-default-fbb48db79-cd564

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-98148a-openshift-default-fbb48db79-cd564

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-98148a-openshift-default-fbb48db79-cd564

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-98148a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-98148a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-98148a-7f86c6bb8d-hnn6l

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-a-98148a-openshift-default-fbb48db79-cd564

ProbeError

Startup probe error: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-98148a-openshift-default-fbb48db79-cd564

Unhealthy

Startup probe failed: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-98148a-5b479ccd4c-dhllc

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-9b65143e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-9b65143e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-a-9a9ea9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9a9ea9

openshift-ingress

replicaset-controller

e2e-api-a-9a9ea9-openshift-default-b548dcd8f

SuccessfulCreate

Created pod: e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

openshift-ingress

deployment-controller

e2e-api-a-9a9ea9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9a9ea9-openshift-default-b548dcd8f from 0 to 1

openshift-ingress

kubelet

e2e-api-a-98148a-openshift-default-fbb48db79-cd564

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

ProbeError

Readiness probe error: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9a9ea9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9a9ea9-5d69fc846b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9a9ea9-5d69fc846b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9a9ea9: serviceaccount "payload-processing-e2e-api-a-9a9ea9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9a9ea9-5d69fc846b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9a9ea9-5d69fc846b-7bfhk

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9a9ea9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9a9ea9-5d69fc846b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9a9ea9: serviceaccount "payload-processing-e2e-api-a-9a9ea9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-wnsb5

openshift-ingress

kubelet

payload-processing-e2e-api-b-33652a-854c8bd4b8-g2cb5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-wnsb5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-9a9ea9-5d69fc846b-7bfhk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-9a9ea9-5d69fc846b-7bfhk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-33652a-7f5ffd9679-mhrbz

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-9a9ea9-5d69fc846b-7bfhk

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-wnsb5

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-wnsb5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-9a9ea9-5d69fc846b-7bfhk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-wnsb5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

Started

Container started

opendatahub

multus

test-curl-7570-ddf4b9

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7570-ddf4b9

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7570-ddf4b9

Created

Container created

opendatahub

kubelet

test-curl-7570-ddf4b9

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 4.148s (4.148s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7570-ddf4b9

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-33652a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-33652a-openshift-default-5ff86849f9-f8rn9

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-33652a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7570-ddf4b9

Killing

Stopping container test-curl-7570-ddf4b9

openshift-ingress

kubelet

payload-processing-e2e-mt-9b65143e-765c4447d-lk6s8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-m7cdp

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-a-6b9849-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6b9849-openshift-default-6bf96f54dc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6b9849

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6b9849

openshift-ingress

replicaset-controller

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc

SuccessfulCreate

Created pod: e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

openshift-ingress

multus

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-1127f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1127f5-openshift-default-578bff5f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-1127f5-openshift-default-578bff5f

SuccessfulCreate

Created pod: e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

openshift-ingress

gateway_labeler_controller

e2e-api-b-1127f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1127f5

openshift-ingress

multus

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6b9849

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-6qbwg
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6b9849: serviceaccount "payload-processing-e2e-ipp-a-6b9849" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6b9849

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6b9849-866bfd4988 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6b9849-866bfd4988

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6b9849-866bfd4988-rqp4c
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6b9849-866bfd4988

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6b9849-866bfd4988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6b9849: serviceaccount "payload-processing-e2e-ipp-a-6b9849" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-6qbwg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-6qbwg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-6qbwg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-6qbwg

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

ProbeError

Readiness probe error: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

Unhealthy

Readiness probe failed: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-866bfd4988-rqp4c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-866bfd4988-rqp4c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-866bfd4988-rqp4c

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-6b9849-866bfd4988-rqp4c

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5

SuccessfulCreate

Created pod: e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

openshift-ingress

deployment-controller

e2e-ipp-a-1b7b5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-1b7b5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-1b7b5e

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1127f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1127f5-5b6dfb8c64 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1127f5: serviceaccount "payload-processing-e2e-api-b-1127f5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1127f5-5b6dfb8c64

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1127f5-5b6dfb8c64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1127f5: serviceaccount "payload-processing-e2e-api-b-1127f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1127f5-5b6dfb8c64

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx

openshift-ingress

multus

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1127f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1127f5-6d95cf796c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1b7b5e: serviceaccount "payload-processing-e2e-ipp-a-1b7b5e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-1b7b5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1b7b5e: serviceaccount "payload-processing-e2e-ipp-a-1b7b5e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-1b7b5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-1b7b5e-6787dbf956 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6b9849-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6b9849-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.616s (3.616s including waiting). Image size: 125353963 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9a9ea9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9a9ea9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.899s (3.899s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-866bfd4988-rqp4c

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9b65143e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9b65143e-765c4447d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9b65143e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9b65143e-7877bc9979 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9b65143e-765c4447d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9b65143e-765c4447d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9b65143e: serviceaccount "payload-processing-e2e-mt-9b65143e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-85fb55f8c5-6qbwg

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9b65143e-7877bc9979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9b65143e-7877bc9979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9b65143e: serviceaccount "payload-processing-e2e-mt-9b65143e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-zkr2h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-9b65143e-765c4447d-vns59

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-zkr2h

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9b65143e-765c4447d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9b65143e-765c4447d-vns59

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9b65143e-7877bc9979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9b65143e-7877bc9979-zkr2h

openshift-ingress

kubelet

payload-processing-e2e-mt-9b65143e-765c4447d-vns59

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-9b65143e-765c4447d-vns59

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-9b65143e-765c4447d-vns59

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-zkr2h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-zkr2h

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9a9ea9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9a9ea9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6b9849-859b56f486

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6b9849

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6b9849

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6b9849-859b56f486 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6b9849-859b56f486

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6b9849-859b56f486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6b9849: serviceaccount "payload-processing-e2e-ipp-a-6b9849" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6b9849: serviceaccount "payload-processing-e2e-ipp-a-6b9849" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9

openshift-ingress

multus

payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9a9ea9-56fbd555c5-wnsb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-9a9ea9-5d69fc846b-7bfhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-6787dbf956-8hsb6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-778bd8ddc9-qzx9m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.183s (4.183s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.163s (4.163s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

ProbeError

Readiness probe error: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

Unhealthy

Readiness probe failed: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1b7b5e: serviceaccount "payload-processing-e2e-ipp-a-1b7b5e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-1b7b5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-1b7b5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-1b7b5e-7fd77b586 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1b7b5e: serviceaccount "payload-processing-e2e-ipp-a-1b7b5e" not found

opendatahub

multus

test-curl-7570-1a30a2

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7570-1a30a2

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7570-1a30a2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

opendatahub

kubelet

test-curl-7570-1a30a2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

Created

Container created

opendatahub

kubelet

test-curl-7570-1a30a2

Killing

Stopping container test-curl-7570-1a30a2

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.653s (2.653s including waiting). Image size: 166620835 bytes.
(x2)

openshift-ingress

kubelet

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-a-f2218a-openshift-default-5dcc9db77c

SuccessfulCreate

Created pod: e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-a-f2218a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f2218a

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.616s (2.616s including waiting). Image size: 166620835 bytes.

openshift-ingress

deployment-controller

e2e-api-a-f2218a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f2218a-openshift-default-5dcc9db77c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-1127f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-1127f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

Started

Container started

openshift-ingress

kubelet

e2e-api-a-9a9ea9-openshift-default-b548dcd8f-zj7ln

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f2218a-669947bdf4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f2218a-669947bdf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f2218a: serviceaccount "payload-processing-e2e-api-a-f2218a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f2218a-669947bdf4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f2218a-669947bdf4-4hqc5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f2218a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f2218a-55d586c86c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f2218a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f2218a-669947bdf4 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f2218a-55d586c86c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f2218a-55d586c86c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f2218a: serviceaccount "payload-processing-e2e-api-a-f2218a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f2218a-55d586c86c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f2218a-55d586c86c-svk82
(x6)

openshift-ingress

kubelet

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-1b7b5e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-f2218a-669947bdf4-4hqc5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f2218a-55d586c86c-svk82

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f2218a-55d586c86c-svk82

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f2218a-669947bdf4-4hqc5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-1b7b5e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-f2218a-669947bdf4-4hqc5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-f2218a-669947bdf4-4hqc5

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f2218a-55d586c86c-svk82

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f2218a-55d586c86c-svk82

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b07e26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b07e26

openshift-ingress

replicaset-controller

e2e-ipp-b-b07e26-openshift-default-78c99c7c89

SuccessfulCreate

Created pod: e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

openshift-ingress

deployment-controller

e2e-ipp-b-b07e26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b07e26-openshift-default-78c99c7c89 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b07e26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b07e26-79f5c4967d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-1127f5-5b6dfb8c64-jpv4g

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.108:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1127f5-6d95cf796c-gqdbx

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.107:50052" within 1s: context deadline exceeded

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-mh944
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b07e26-79f5c4967d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b07e26-79f5c4967d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b07e26: serviceaccount "payload-processing-e2e-ipp-b-b07e26" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b07e26: serviceaccount "payload-processing-e2e-ipp-b-b07e26" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b07e26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b07e26-79f5c4967d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b07e26-79f5c4967d-q8fdn

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-1127f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-1127f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7

SuccessfulCreate

Created pod: e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d6789f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d6789f

openshift-ingress

multus

payload-processing-e2e-ipp-b-b07e26-79f5c4967d-q8fdn

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b07e26-79f5c4967d-q8fdn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-mh944

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-mh944

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-d6789f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d6789f-openshift-default-7658fb4fc7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-mh944

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b07e26-79f5c4967d-q8fdn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-mh944

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b07e26-79f5c4967d-q8fdn

Created

Container created

openshift-ingress

multus

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-bf9b0a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9

SuccessfulCreate

Created pod: e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bf9b0a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bf9b0a

openshift-ingress

multus

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d6789f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-bxg6s

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d6789f-84db6df874

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d6789f-84db6df874-vqsnm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d6789f-84db6df874

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d6789f-84db6df874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d6789f: serviceaccount "payload-processing-e2e-ipp-b-d6789f" not found

openshift-ingress

kubelet

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d6789f: serviceaccount "payload-processing-e2e-ipp-b-d6789f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d6789f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d6789f-84db6df874 from 0 to 1

openshift-ingress

kubelet

e2e-api-b-1127f5-openshift-default-578bff5f-gdbqm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6789f-84db6df874-vqsnm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-bxg6s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-d6789f-84db6df874-vqsnm

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6789f-84db6df874-vqsnm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-bxg6s

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6789f-84db6df874-vqsnm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-bxg6s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-bxg6s

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-rjzt5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-vs2wv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf9b0a: serviceaccount "payload-processing-e2e-ipp-a-bf9b0a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bf9b0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bf9b0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b07e26-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b07e26-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf9b0a: serviceaccount "payload-processing-e2e-ipp-a-bf9b0a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-rjzt5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-rjzt5

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-vs2wv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-vs2wv

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-rjzt5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-rjzt5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-vs2wv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-vs2wv

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6b9849-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6b9849-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-api-b-400777-openshift-default-845498b657

SuccessfulCreate

Created pod: e2e-api-b-400777-openshift-default-845498b657-kg7b2

openshift-ingress

deployment-controller

e2e-api-b-400777-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-400777-openshift-default-845498b657 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-400777

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-400777

openshift-ingress

multus

e2e-api-b-400777-openshift-default-845498b657-kg7b2

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-x8ffs

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-400777

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-400777-776c774778 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x8ffs

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-x8ffs

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x8ffs

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x8ffs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-400777-776c774778-4mwtz

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-400777

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-400777-7db698cc79 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-1b7b5e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-400777-776c774778

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-400777-776c774778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-400777: serviceaccount "payload-processing-e2e-api-b-400777" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-400777-776c774778

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-400777-776c774778-4mwtz

openshift-ingress

kubelet

payload-processing-e2e-api-b-400777-776c774778-4mwtz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-1b7b5e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-400777-7db698cc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-400777-7db698cc79-nshlh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-400777-7db698cc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-400777-7db698cc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-400777: serviceaccount "payload-processing-e2e-api-b-400777" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x8ffs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x8ffs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-400777-776c774778-4mwtz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-400777-7db698cc79-nshlh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-400777-776c774778-4mwtz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-400777-7db698cc79-nshlh

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-400777-7db698cc79-nshlh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-400777-7db698cc79-nshlh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9

SuccessfulCreate

Created pod: e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-9b65143e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-9b65143e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9b65143e-openshift-default-5ddf6c8dd9 from 1 to 2

openshift-ingress

multus

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

Created

Container created

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

Started

Container started

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b07e26-74757d58b7-mh944

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b07e26-79f5c4967d-q8fdn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9b65143e-765c4447d-vns59

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9b65143e-7877bc9979-zkr2h

Killing

Stopping container payload-pre-processing
(x8)

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

Unhealthy

Startup probe failed: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

ProbeError

Startup probe error: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6789f-84db6df874-vqsnm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6789f-c97f6555f-bxg6s

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b07e26: serviceaccount "payload-processing-e2e-ipp-b-b07e26" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-f5chr

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b07e26-667f9bbb68

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b07e26-667f9bbb68-rb9v7

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b07e26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b07e26-667f9bbb68 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b07e26-667f9bbb68

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b07e26-667f9bbb68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b07e26: serviceaccount "payload-processing-e2e-ipp-b-b07e26" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b07e26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-f5chr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b07e26-667f9bbb68-rb9v7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9b0a-595ccbdd5b-rjzt5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9b0a-759b9dfff9-vs2wv

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-b07e26-667f9bbb68-rb9v7

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-f5chr

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b07e26-667f9bbb68-rb9v7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-f5chr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b07e26-667f9bbb68-rb9v7

Started

Container started

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-lwk8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-9b65143e-openshift-default-5ddf6c8dd9-kwbtk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-f5chr

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-2eee8c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-2eee8c

openshift-ingress

deployment-controller

e2e-ipp-a-2eee8c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55

SuccessfulCreate

Created pod: e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

ProbeError

Readiness probe error: Get "http://10.134.0.115:15021/healthz/ready": read tcp 10.134.0.2:37594->10.134.0.115:15021: read: connection reset by peer body:

openshift-ingress

multus

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

Unhealthy

Readiness probe failed: Get "http://10.134.0.115:15021/healthz/ready": read tcp 10.134.0.2:37594->10.134.0.115:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d6789f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d6789f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d6789f-6f5c4b4944 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d6789f: serviceaccount "payload-processing-e2e-ipp-b-d6789f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d6789f-6f5c4b4944

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d6789f: serviceaccount "payload-processing-e2e-ipp-b-d6789f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-gtfqs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-gtfqs

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-gtfqs

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d6789f-6f5c4b4944

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-c26g9
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d6789f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2eee8c-5bb486f988

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2eee8c-5bb486f988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2eee8c: serviceaccount "payload-processing-e2e-ipp-a-2eee8c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2eee8c: serviceaccount "payload-processing-e2e-ipp-a-2eee8c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-kt456
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d6789f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-c26g9

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-gtfqs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-gtfqs

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2eee8c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2eee8c-5bb486f988

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2eee8c-5bb486f988-vrdks

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2eee8c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2eee8c-5bb486f988 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-c26g9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-c26g9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-c26g9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-2eee8c-5bb486f988-vrdks

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-kt456

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2eee8c-5bb486f988-vrdks

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2eee8c-5bb486f988-vrdks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-kt456

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-kt456

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2eee8c-5bb486f988-vrdks

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-kt456

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bf9b0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf9b0a: serviceaccount "payload-processing-e2e-ipp-a-bf9b0a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bf9b0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-khzkt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf9b0a: serviceaccount "payload-processing-e2e-ipp-a-bf9b0a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-zqrq7

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-zqrq7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-zqrq7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-khzkt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-zqrq7

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-khzkt

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-khzkt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-zqrq7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-khzkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f2218a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f2218a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f2218a-55d586c86c-svk82

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d6789f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-f2218a-669947bdf4-4hqc5

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d6789f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-b-efba68-openshift-default-754b857845

SuccessfulCreate

Created pod: e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

openshift-ingress

deployment-controller

e2e-ipp-b-efba68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-efba68-openshift-default-754b857845 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-efba68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-efba68

openshift-ingress

kubelet

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

ProbeError

Readiness probe error: Get "http://10.132.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

Unhealthy

Readiness probe failed: Get "http://10.132.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1b7b5e-85c67c759-kh8lj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-f2218a-openshift-default-5dcc9db77c-kmld7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1b7b5e-7fd77b586-lkpvg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-efba68-69596d49cd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-efba68-69596d49cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-efba68: serviceaccount "payload-processing-e2e-ipp-b-efba68" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-efba68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-efba68-75766bf75 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-efba68-75766bf75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-efba68-75766bf75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-efba68: serviceaccount "payload-processing-e2e-ipp-b-efba68" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-efba68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-efba68-69596d49cd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-b-400777-openshift-default-845498b657-kg7b2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-400777-openshift-default-845498b657-kg7b2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-400777-openshift-default-845498b657-kg7b2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-efba68-75766bf75-sxn6f

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-75766bf75-sxn6f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-75766bf75-sxn6f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-efba68-69596d49cd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-efba68-69596d49cd-c72m5

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-69596d49cd-c72m5

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-efba68-75766bf75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-efba68-75766bf75-sxn6f

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-69596d49cd-c72m5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-69596d49cd-c72m5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-efba68-69596d49cd-c72m5

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-75766bf75-sxn6f

Started

Container started

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-6b9849

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-6b9849: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-6b9849": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-6b9849, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 10d16001-2b85-48ba-864f-bf99fd002e1b, UID in object meta:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-400777-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6b9849-859b56f486-zs2nq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-400777-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6b9849-659cb7bb8c-lgxr9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-5b5bcf6d7f-kt456

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2eee8c-5bb486f988-vrdks

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-1b7b5e-openshift-default-6d7fc588c5-ktnmh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-400777-7db698cc79-nshlh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-400777-776c774778-4mwtz

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-api-b-400777-openshift-default-845498b657-kg7b2

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-400777-openshift-default-845498b657-kg7b2

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bf9b0a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bf9b0a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-gmn24

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 9 to 7

openshift-ingress

kubelet

e2e-ipp-a-6b9849-openshift-default-6bf96f54dc-2cvtn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-m9xd8

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b07e26-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b07e26-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2eee8c-5f66985b86

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2eee8c-5f66985b86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2eee8c: serviceaccount "payload-processing-e2e-ipp-a-2eee8c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2eee8c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2eee8c: serviceaccount "payload-processing-e2e-ipp-a-2eee8c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2eee8c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2eee8c-5f66985b86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2eee8c-5f66985b86

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2eee8c-5f66985b86-868h2

openshift-ingress

multus

payload-processing-e2e-ipp-a-2eee8c-5f66985b86-868h2

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2eee8c-5f66985b86-868h2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2eee8c-5f66985b86-868h2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2eee8c-5f66985b86-868h2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-400777-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-400777-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-400777-openshift-default-845498b657-kg7b2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bf9b0a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bf9b0a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-400777-openshift-default-845498b657-kg7b2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-400777-openshift-default-845498b657-kg7b2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-praxis-a-82c116-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-82c116-openshift-default-57f8d74ccc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-82c116

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-82c116

openshift-ingress

replicaset-controller

e2e-praxis-a-82c116-openshift-default-57f8d74ccc

SuccessfulCreate

Created pod: e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

openshift-ingress

multus

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6789f-6955f99bf9-gtfqs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6789f-6f5c4b4944-c26g9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-69596d49cd-c72m5

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-82c116

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-82c116-747858446 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-82c116-747858446

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-82c116-747858446-4c54z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-82c116-747858446

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-82c116-747858446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-82c116: serviceaccount "payload-processing-e2e-praxis-a-82c116" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-82c116

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-82c116-745b5997f9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-82c116-745b5997f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-82c116: serviceaccount "payload-processing-e2e-praxis-a-82c116" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-82c116-745b5997f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-v98g9

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2eee8c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-75766bf75-sxn6f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-v98g9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-v98g9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-v98g9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-v98g9

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-82c116-747858446-4c54z

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2eee8c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-82c116-747858446-4c54z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-82c116-747858446-4c54z

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-82c116-747858446-4c54z

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-d6789f-openshift-default-7658fb4fc7-hx4d8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-1142fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-1142fd

openshift-ingress

deployment-controller

e2e-ipp-b-1142fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-1142fd-openshift-default-5d4d9469c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-1142fd-openshift-default-5d4d9469c

SuccessfulCreate

Created pod: e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b07e26-667f9bbb68-rb9v7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b07e26-5bd49584dc-f5chr

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-praxis-a-3f36ae-openshift-default-657644fd77

SuccessfulCreate

Created pod: e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

openshift-ingress

deployment-controller

e2e-praxis-a-3f36ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3f36ae-openshift-default-657644fd77 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-3f36ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-3f36ae

openshift-ingress

multus

e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-efba68: serviceaccount "payload-processing-e2e-ipp-b-efba68" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1142fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1142fd-7fd577747d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1142fd-7fd577747d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1142fd-7fd577747d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1142fd: serviceaccount "payload-processing-e2e-ipp-b-1142fd" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1142fd-54964f48c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1142fd: serviceaccount "payload-processing-e2e-ipp-b-1142fd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1142fd-54964f48c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-6xlsp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-efba68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1142fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1142fd-54964f48c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1142fd-7fd577747d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1142fd-7fd577747d-x9fvm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-efba68-5f5cd4549b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-efba68-5f5cd4549b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-efba68: serviceaccount "payload-processing-e2e-ipp-b-efba68" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-efba68-5f5cd4549b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-efba68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-efba68-5f5cd4549b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-1142fd-7fd577747d-x9fvm

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-6xlsp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1142fd-7fd577747d-x9fvm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1142fd-7fd577747d-x9fvm

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1142fd-7fd577747d-x9fvm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-6xlsp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-6xlsp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-6xlsp

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3f36ae-8479797959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-ngkfj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3f36ae-f89b78796

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-3f36ae-f89b78796-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3f36ae: serviceaccount "payload-processing-e2e-praxis-a-3f36ae" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-3f36ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-3f36ae-8479797959 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3f36ae-8479797959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3f36ae: serviceaccount "payload-processing-e2e-praxis-a-3f36ae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-3f36ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-3f36ae-f89b78796 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3f36ae-f89b78796

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-3f36ae-f89b78796-vtwt6
(x2)

openshift-ingress

kubelet

e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-ngkfj

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3f36ae-f89b78796-vtwt6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3f36ae-f89b78796-vtwt6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3f36ae-f89b78796-vtwt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-ngkfj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-ngkfj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-ngkfj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-3f36ae-f89b78796-vtwt6

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-b07e26-openshift-default-78c99c7c89-gdxzh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-a596f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-a596f7

openshift-ingress

deployment-controller

e2e-praxis-a-a596f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a596f7-openshift-default-d48f46df from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-a596f7-openshift-default-d48f46df

SuccessfulCreate

Created pod: e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

openshift-ingress

multus

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z
(x5)

openshift-ingress

kubelet

e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-4mlxm

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-7j92z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-phzjb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-77vt5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-a596f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-a596f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-a596f7-5955dc7bc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-x8f4f
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a596f7-5955dc7bc6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a596f7: serviceaccount "payload-processing-e2e-praxis-a-a596f7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-x8f4f

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-x8f4f

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-x8f4f

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a596f7: serviceaccount "payload-processing-e2e-praxis-a-a596f7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a596f7-5955dc7bc6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-dqp4k

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-x8f4f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-dqp4k

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-dqp4k

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-dqp4k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-dqp4k

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-efba68-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-efba68-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-c4f356

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-c4f356

openshift-ingress

replicaset-controller

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf

SuccessfulCreate

Created pod: e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2eee8c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2eee8c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-b-c4f356-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c4f356-openshift-default-845ddfdbdf from 0 to 1

openshift-ingress

multus

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1142fd-7fd577747d-x9fvm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1142fd-54964f48c-6xlsp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-1142fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-1142fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c4f356-65984ccdd8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-c4f356-65984ccdd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c4f356: serviceaccount "payload-processing-e2e-praxis-b-c4f356" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-4v99j
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c4f356: serviceaccount "payload-processing-e2e-praxis-b-c4f356" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c4f356-65984ccdd8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-c4f356-65984ccdd8-8sssn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-c4f356

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-c4f356

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-c4f356-65984ccdd8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-praxis-b-c4f356-65984ccdd8-8sssn

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-4v99j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c4f356-65984ccdd8-8sssn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c4f356-65984ccdd8-8sssn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c4f356-65984ccdd8-8sssn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-4v99j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-4v99j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-4v99j

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9b0a-5c6b44795d-zqrq7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9b0a-8b8845fc5-khzkt

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-bf9b0a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-bf9b0a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-bf9b0a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-bf9b0a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a934c223-85d1-4ca1-9364-9db3c4f96cb1, UID in object meta:

openshift-ingress

multus

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-1b646f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-1b646f

openshift-ingress

deployment-controller

e2e-praxis-b-1b646f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-1b646f-openshift-default-b8c6768df from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-82c116-openshift-default-57f8d74ccc

SuccessfulCreate

Created pod: e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

openshift-ingress

replicaset-controller

e2e-praxis-b-1b646f-openshift-default-b8c6768df

SuccessfulCreate

Created pod: e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

openshift-ingress

replicaset-controller

e2e-praxis-a-82c116-openshift-default-57f8d74ccc

SuccessfulCreate

Created pod: e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-82c116-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-82c116-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-82c116-openshift-default-57f8d74ccc from 1 to 3

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-efba68-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-efba68-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1142fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-54r28
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1142fd: serviceaccount "payload-processing-e2e-ipp-b-1142fd" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1142fd: serviceaccount "payload-processing-e2e-ipp-b-1142fd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-2cffl

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1142fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-54r28

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-2cffl

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-2cffl

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-2cffl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-2cffl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-54r28

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-54r28

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-54r28

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-1b646f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-1b646f-8686c6c6b8 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-1b646f: serviceaccount "payload-processing-e2e-praxis-b-1b646f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-lgfn7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-1b646f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-1b646f-8686c6c6b8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-1b646f: serviceaccount "payload-processing-e2e-praxis-b-1b646f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-1b646f-8686c6c6b8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-sj8kj

openshift-ingress

multus

payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-sj8kj

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-lgfn7

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-sj8kj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

Unhealthy

Startup probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-lgfn7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-sj8kj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-sj8kj

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

ProbeError

Startup probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-lgfn7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-lgfn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-bf9b0a-openshift-default-76dc4dcdf9-7txq8

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-praxis-b-9e5029-openshift-default-86bf88c645

SuccessfulCreate

Created pod: e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

openshift-ingress

deployment-controller

e2e-praxis-b-9e5029-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9e5029-openshift-default-86bf88c645 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-9e5029

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-9e5029

openshift-ingress

kubelet

e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-82c116-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-82c116-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-9e5029

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-9q8z2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9e5029: serviceaccount "payload-processing-e2e-praxis-b-9e5029" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1b646f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1b646f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-9e5029

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-9e5029-7df69b99fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9e5029-7df69b99fd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-9e5029-7df69b99fd-4qsmw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9e5029-7df69b99fd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-9e5029-7df69b99fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9e5029: serviceaccount "payload-processing-e2e-praxis-b-9e5029" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-9q8z2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-9e5029-7df69b99fd-4qsmw

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9e5029-7df69b99fd-4qsmw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9e5029-7df69b99fd-4qsmw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-9q8z2

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-9q8z2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9e5029-7df69b99fd-4qsmw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-9q8z2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj

Unhealthy

Readiness probe failed: dial tcp 10.132.0.159:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efba68-5b9dc8d895-mpkqj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efba68-5f5cd4549b-rxr5h

Unhealthy

Readiness probe failed: dial tcp 10.132.0.160:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-efba68-openshift-default-754b857845-ctf58

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-019ef4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-019ef4

openshift-ingress

replicaset-controller

e2e-praxis-a-019ef4-openshift-default-768d646ffc

SuccessfulCreate

Created pod: e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

openshift-ingress

deployment-controller

e2e-praxis-a-019ef4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-019ef4-openshift-default-768d646ffc from 0 to 1

openshift-ingress

multus

e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-82c116-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-82c116-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-019ef4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-019ef4-68fc7d79d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-grxwv

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-019ef4-68fc7d79d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-019ef4-68fc7d79d-h48b5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-019ef4: serviceaccount "payload-processing-e2e-praxis-a-019ef4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-019ef4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-019ef4-68fc7d79d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-019ef4-68fc7d79d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-019ef4: serviceaccount "payload-processing-e2e-praxis-a-019ef4" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-019ef4-68fc7d79d-h48b5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-019ef4-68fc7d79d-h48b5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-019ef4-68fc7d79d-h48b5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-019ef4-68fc7d79d-h48b5

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-grxwv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-grxwv

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-grxwv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-grxwv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-82c116-747858446-4c54z

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-82c116-745b5997f9-v98g9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-1142fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-1142fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3f36ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3f36ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq

Unhealthy

Startup probe failed: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq

ProbeError

Startup probe error: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9e5029-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9e5029-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 10 to 9

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-88tr4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-vzhd4

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-vk6dn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-82c116-openshift-default-57f8d74ccc-r9659

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3f36ae-f89b78796-vtwt6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3f36ae-8479797959-ngkfj

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a596f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c4f356-65984ccdd8-8sssn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c4f356-54685dc96c-4v99j

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a596f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c4f356-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c4f356-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a596f7-5955dc7bc6-dqp4k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a596f7-6899469bf5-x8f4f

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3f36ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3f36ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-3f36ae-openshift-default-657644fd77-v4fw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-c4f356-openshift-default-845ddfdbdf-dhlxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1b646f-8686c6c6b8-sj8kj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1b646f-6d7d8c7847-lgfn7

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a596f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a596f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-59bc3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-59bc3b

openshift-ingress

deployment-controller

e2e-praxis-b-59bc3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5

SuccessfulCreate

Created pod: e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulDelete

Deleted pod: e2e-worker-w2-085566-openshift-default-9958546fc-9kx67

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-085566-openshift-default-9958546fc from 10 to 9

openshift-ingress

kubelet

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-a596f7-openshift-default-d48f46df-qxkpg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-59bc3b-6f849ff658

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-59bc3b-6f849ff658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-59bc3b: serviceaccount "payload-processing-e2e-praxis-b-59bc3b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-kdtdl

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-59bc3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-59bc3b-6f849ff658 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-59bc3b-6f849ff658

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-59bc3b-6f849ff658-8gvkb

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-kdtdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-kdtdl

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-kdtdl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-59bc3b-6f849ff658-8gvkb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-kdtdl

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-59bc3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-59bc3b: serviceaccount "payload-processing-e2e-praxis-b-59bc3b" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-59bc3b-6f849ff658-8gvkb

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-59bc3b-6f849ff658-8gvkb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-59bc3b-6f849ff658-8gvkb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1b646f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1b646f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9e5029-c4df44dff-9q8z2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9e5029-7df69b99fd-4qsmw

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-1b646f-openshift-default-b8c6768df-7ftjz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55

SuccessfulCreate

Created pod: e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

openshift-ingress

deployment-controller

e2e-ipp-a-2eee8c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2eee8c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-019ef4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-019ef4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

ProbeError

Startup probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

Unhealthy

Startup probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

Unhealthy

Readiness probe failed: Get "http://10.132.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-9e5029-openshift-default-86bf88c645-s5lrd

ProbeError

Readiness probe error: Get "http://10.132.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-59bc3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-59bc3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-019ef4-88cccb99f-grxwv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-019ef4-68fc7d79d-h48b5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-019ef4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-019ef4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-019ef4-openshift-default-768d646ffc-5ch59

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 8 to 10

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

Started

Container started

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-59bc3b-58ccf8847f-kdtdl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-59bc3b-6f849ff658-8gvkb

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

Unhealthy

Startup probe failed: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

ProbeError

Startup probe error: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-59bc3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-59bc3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

ProbeError

Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

Unhealthy

Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-59bc3b-openshift-default-54cf78d8b5-gn2g5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

ProbeError

Startup probe error: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

Unhealthy

Startup probe failed: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

Unhealthy

Readiness probe failed: Get "http://10.134.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

Unhealthy

Readiness probe failed: Get "http://10.132.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

ProbeError

Readiness probe error: Get "http://10.132.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

ProbeError

Readiness probe error: Get "http://10.134.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

Unhealthy

Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

ProbeError

Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

ProbeError

Readiness probe error: Get "http://10.132.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

Unhealthy

Readiness probe failed: Get "http://10.132.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 9 to 10

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-7a92d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-7a92d4

openshift-ingress

deployment-controller

e2e-shared-a-w1-7a92d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc

SuccessfulCreate

Created pod: e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 8 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

Unhealthy

Startup probe failed: Get "http://10.134.0.158:15021/healthz/ready": dial tcp 10.134.0.158:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

Created

Container created
(x10)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

ProbeError

Startup probe error: Get "http://10.134.0.158:15021/healthz/ready": dial tcp 10.134.0.158:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

ProbeError

Startup probe error: Get "http://10.134.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

Unhealthy

Startup probe failed: Get "http://10.134.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-7a92d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-5bgqc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-7a92d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-w9rlb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-7a92d4: serviceaccount "payload-processing-e2e-shared-a-w1-7a92d4" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-7a92d4: serviceaccount "payload-processing-e2e-shared-a-w1-7a92d4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-w9rlb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-5bgqc

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-w9rlb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-5bgqc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-w9rlb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-w9rlb

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-5bgqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-5bgqc

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

Unhealthy

Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

ProbeError

Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-3c25bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-3c25bf

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-08a7bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-08a7bc

openshift-ingress

replicaset-controller

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc

SuccessfulCreate

Created pod: e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-3c25bf-664f9598

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-3c25bf-664f9598-fzb5f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-3c25bf: serviceaccount "payload-processing-e2e-shared-a-w4-3c25bf" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-3c25bf-664f9598

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-3c25bf-664f9598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-3c25bf: serviceaccount "payload-processing-e2e-shared-a-w4-3c25bf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-3c25bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-3c25bf-664f9598 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-3c25bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-r8rrz

openshift-ingress

deployment-controller

e2e-shared-b-w1-08a7bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-08a7bc-openshift-default-5864477cc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-r8rrz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-3c25bf-664f9598-fzb5f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-r8rrz

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-3c25bf-664f9598-fzb5f

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2eee8c-5f66985b86-868h2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2eee8c-f9d7cc995-5gnjd

Unhealthy

Readiness probe failed: dial tcp 10.132.0.155:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-3c25bf-664f9598-fzb5f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-3c25bf-664f9598-fzb5f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-r8rrz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-r8rrz

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-984ck

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2eee8c-openshift-default

FailedGetScale

deployments.apps "e2e-ipp-a-2eee8c-openshift-default" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2eee8c-openshift-default

FailedUpdateStatus

horizontalpodautoscalers.autoscaling "e2e-ipp-a-2eee8c-openshift-default" not found

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-ba89e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-ba89e0

openshift-ingress

deployment-controller

e2e-shared-a-w0-ba89e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc

SuccessfulCreate

Created pod: e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-08a7bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-s56vz
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-08a7bc: serviceaccount "payload-processing-e2e-shared-b-w1-08a7bc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-hvfxj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-08a7bc: serviceaccount "payload-processing-e2e-shared-b-w1-08a7bc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-08a7bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-hvfxj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-s56vz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-hvfxj

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-hvfxj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-s56vz

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-hvfxj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-s56vz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-s56vz

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-bab2c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-bab2c3

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-2eee8c-openshift-default-7bb66d8f55-6tzlq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-ba89e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-ba89e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-ba89e0: serviceaccount "payload-processing-e2e-shared-a-w0-ba89e0" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-ba89e0: serviceaccount "payload-processing-e2e-shared-a-w0-ba89e0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1142fd-66fd5b6bd4-2cffl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1142fd-76f76b5df9-54r28

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-nxgfd

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-bab2c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-bab2c3: serviceaccount "payload-processing-e2e-shared-a-w3-bab2c3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-bab2c3: serviceaccount "payload-processing-e2e-shared-a-w3-bab2c3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-lkjxh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-bab2c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-nxgfd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-nxgfd

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-nxgfd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-nxgfd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-lkjxh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-lkjxh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-lkjxh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-lkjxh

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes
(x10)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Unhealthy

Readiness probe failed: Get "https://10.133.0.38:8000/ready": context deadline exceeded
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Unhealthy

Liveness probe failed: Get "https://10.133.0.38:8000/health": context deadline exceeded
(x13)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-tdxw5

Unhealthy

Readiness probe failed: Get "https://10.133.0.38:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-3211a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-3211a0

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

openshift-ingress

deployment-controller

e2e-praxis-a-3211a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3211a0-openshift-default-748fcc5f5c from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-1142fd-openshift-default-5d4d9469c-r7szm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w4-30e9de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5

SuccessfulCreate

Created pod: e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-30e9de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-30e9de

openshift-ingress

multus

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3211a0: serviceaccount "payload-processing-e2e-praxis-a-3211a0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3211a0-646899f4fb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-3211a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3211a0-646899f4fb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-3211a0-646899f4fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3211a0: serviceaccount "payload-processing-e2e-praxis-a-3211a0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-3211a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-3211a0-646899f4fb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-30e9de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-30e9de-54f79c474b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-dh4jg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-30e9de: serviceaccount "payload-processing-e2e-shared-b-w4-30e9de" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-gjhzn

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-30e9de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-30e9de-54f79c474b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-30e9de-54f79c474b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-30e9de: serviceaccount "payload-processing-e2e-shared-b-w4-30e9de" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-gjhzn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-gjhzn

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-gjhzn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-dh4jg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-dh4jg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-dh4jg

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-dh4jg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-gjhzn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-99a8fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-99a8fe

openshift-ingress

replicaset-controller

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677

SuccessfulCreate

Created pod: e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

openshift-ingress

deployment-controller

e2e-shared-b-w0-99a8fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-99a8fe-openshift-default-579f8df677 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-99a8fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-99a8fe: serviceaccount "payload-processing-e2e-shared-b-w0-99a8fe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-99a8fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-6e5139

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-6e5139

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p

openshift-ingress

deployment-controller

e2e-shared-b-w3-6e5139-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5

SuccessfulCreate

Created pod: e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-99a8fe: serviceaccount "payload-processing-e2e-shared-b-w0-99a8fe" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-88znp

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-6e5139

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6e5139: serviceaccount "payload-processing-e2e-shared-b-w3-6e5139" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6e5139: serviceaccount "payload-processing-e2e-shared-b-w3-6e5139" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-6e5139

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-nt27p

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-88znp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-88znp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-nt27p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-nt27p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-nt27p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-nt27p

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-88znp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-88znp

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3211a0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3211a0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-b-6bd876-openshift-default-db6f74989

SuccessfulCreate

Created pod: e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

openshift-ingress

deployment-controller

e2e-praxis-b-6bd876-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-6bd876-openshift-default-db6f74989 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-6bd876

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-6bd876

openshift-ingress

multus

e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-6bd876-c87b98655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-9mjnk
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-6bd876-c87b98655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-6bd876: serviceaccount "payload-processing-e2e-praxis-b-6bd876" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-6bd876

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-6bd876-5464b6d8d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-6bd876

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-6bd876-c87b98655 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-6bd876-5464b6d8d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-6bd876-5464b6d8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-6bd876: serviceaccount "payload-processing-e2e-praxis-b-6bd876" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-6bd876-5464b6d8d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-6bd876-5464b6d8d-ds4b8
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6bd876-5464b6d8d-ds4b8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-9mjnk

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-6bd876-5464b6d8d-ds4b8

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-9mjnk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-9mjnk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-9mjnk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6bd876-5464b6d8d-ds4b8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6bd876-5464b6d8d-ds4b8

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ba89e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ba89e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 1 to 4

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

Created

Container created

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-a-3211a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3211a0-openshift-default-748fcc5f5c from 1 to 4

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 1 to 4

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3211a0-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

Created

Container created

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

Unhealthy

Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

ProbeError

Startup probe error: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

ProbeError

Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

Unhealthy

Startup probe failed: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6e5139-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6e5139-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

ProbeError

Startup probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

Unhealthy

Startup probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7a92d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7a92d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

ProbeError

Startup probe error: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

Unhealthy

Startup probe failed: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

Unhealthy

Startup probe failed: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

Unhealthy

Startup probe failed: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

ProbeError

Startup probe error: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

ProbeError

Startup probe error: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7a92d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7a92d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulDelete

Deleted pod: e2e-worker-w2-085566-openshift-default-9958546fc-gvh7m

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-085566-openshift-default-9958546fc from 9 to 8
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3211a0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3211a0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

Unhealthy

Readiness probe failed: Get "http://10.132.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

Unhealthy

Readiness probe failed: Get "http://10.132.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

ProbeError

Readiness probe error: Get "http://10.132.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

ProbeError

Readiness probe error: Get "http://10.132.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

ProbeError

Readiness probe error: Get "http://10.132.0.199:15021/healthz/ready": read tcp 10.132.0.2:36442->10.132.0.199:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

Unhealthy

Readiness probe failed: Get "http://10.132.0.199:15021/healthz/ready": read tcp 10.132.0.2:36442->10.132.0.199:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ba89e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ba89e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 4 to 8

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

Created

Container created

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

Started

Container started

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 4 to 8

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

openshift-ingress

deployment-controller

e2e-praxis-a-3211a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3211a0-openshift-default-748fcc5f5c from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3211a0-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-30e9de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-30e9de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

Started

Container started

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

Created

Container created

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

Started

Container started

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

ProbeError

Startup probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

Unhealthy

Startup probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

Unhealthy

Startup probe failed: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

ProbeError

Startup probe error: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-08a7bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-08a7bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

Unhealthy

Startup probe failed: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qzxvv

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": context deadline exceeded
(x10)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

ProbeError

Startup probe error: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

ProbeError

Startup probe error: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

Unhealthy

Startup probe failed: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

ProbeError

Startup probe error: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

Unhealthy

Startup probe failed: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

(combined from similar events): Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulCreate

Created pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm
(x9)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

ProbeError

Startup probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

Unhealthy

Startup probe failed: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 8 to 10
(x9)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

ProbeError

Startup probe error: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

Unhealthy

Startup probe failed: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 10; reason:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

ProbeError

Startup probe error: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

Unhealthy

Startup probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulCreate

(combined from similar events): Created pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 8 to 10

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-30e9de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-30e9de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

ProbeError

Startup probe error: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

Unhealthy

Startup probe failed: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

ProbeError

Startup probe error: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

Unhealthy

Startup probe failed: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-99a8fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-99a8fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-08a7bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-08a7bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulDelete

Deleted pod: e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-085566-openshift-default-9958546fc from 8 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-j86hv

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6bd876-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6bd876-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

ProbeError

Readiness probe error: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

Unhealthy

Readiness probe failed: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc

SuccessfulCreate

Created pod: e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

openshift-ingress

deployment-controller

e2e-shared-a-w0-ba89e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ba89e0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

Started

Container started

openshift-ingress

multus

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5

SuccessfulCreate

Created pod: e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

ProbeError

Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

Unhealthy

Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-30e9de-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w4-30e9de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5 from 1 to 2

openshift-ingress

multus

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6bd876-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6bd876-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6e5139-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6e5139-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3211a0-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

(combined from similar events): Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

openshift-ingress

replicaset-controller

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c

SuccessfulCreate

Created pod: e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

openshift-ingress

deployment-controller

e2e-praxis-a-3211a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3211a0-openshift-default-748fcc5f5c from 8 to 10

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

Started

Container started

openshift-ingress

multus

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

Unhealthy

Startup probe failed: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

ProbeError

Startup probe error: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-zrpdx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-ccq47

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb

Killing

Stopping container payload-pre-processing

opendatahub

multus

test-curl-7564-7616a6

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7564-7616a6

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7564-7616a6

Created

Container created

opendatahub

kubelet

test-curl-7564-7616a6

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3211a0-646899f4fb-j2thq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3211a0-75bb75df75-w6xkb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

kubelet

test-curl-7564-7616a6

Killing

Stopping container test-curl-7564-7616a6

opendatahub

kubelet

test-curl-7567-a8e60d

Started

Container started

opendatahub

kubelet

test-curl-7567-a8e60d

Created

Container created

opendatahub

kubelet

test-curl-7567-a8e60d

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7567-a8e60d

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

opendatahub

multus

test-curl-7567-829b9a

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7567-a8e60d

Killing

Stopping container test-curl-7567-a8e60d

opendatahub

kubelet

test-curl-7567-829b9a

Started

Container started

opendatahub

kubelet

test-curl-7567-829b9a

Created

Container created

opendatahub

kubelet

test-curl-7567-829b9a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7567-829b9a

Killing

Stopping container test-curl-7567-829b9a

opendatahub

kubelet

test-curl-7567-b0ef96

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7567-b0ef96

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7567-b0ef96

Started

Container started

opendatahub

kubelet

test-curl-7567-b0ef96

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fn4t5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-nks2m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-c2m79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7567-e20206

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-gfmt7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-hxbd8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-d985c

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7567-e20206

AddedInterface

Add eth0 [10.132.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-t9b29

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-mtctw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-7567-b0ef96

Killing

Stopping container test-curl-7567-b0ef96

opendatahub

kubelet

test-curl-7567-e20206

Created

Container created

opendatahub

kubelet

test-curl-7567-e20206

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-fbt69

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-3211a0-openshift-default-748fcc5f5c-5hbft

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-7567-3041f7

Started

Container started

opendatahub

kubelet

test-curl-7567-3041f7

Created

Container created

opendatahub

kubelet

test-curl-7567-3041f7

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7567-e20206

Killing

Stopping container test-curl-7567-e20206

opendatahub

multus

test-curl-7567-3041f7

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677

SuccessfulCreate

Created pod: e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

openshift-ingress

deployment-controller

e2e-shared-b-w0-99a8fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-99a8fe-openshift-default-579f8df677 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-99a8fe-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-dce009

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-dce009

openshift-ingress

multus

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

Created

Container created

opendatahub

kubelet

test-curl-7567-3041f7

Killing

Stopping container test-curl-7567-3041f7

openshift-ingress

deployment-controller

e2e-extmod-a-dce009-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-dce009-openshift-default-57db6cbb9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-dce009-openshift-default-57db6cbb9c

SuccessfulCreate

Created pod: e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6bd876-5464b6d8d-ds4b8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6bd876-c87b98655-9mjnk

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-dce009: serviceaccount "payload-processing-e2e-extmod-a-dce009" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-dce009-5fbcf89498

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-dce009-5fbcf89498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-dce009: serviceaccount "payload-processing-e2e-extmod-a-dce009" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-dce009

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-dce009-748986cfc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-dce009

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-dce009-5fbcf89498 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-dce009-5fbcf89498

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-dce009-5fbcf89498-c29n4

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-dce009-5fbcf89498-c29n4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

ProbeError

Startup probe error: Get "http://10.134.0.196:15021/healthz/ready": dial tcp 10.134.0.196:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

Unhealthy

Startup probe failed: Get "http://10.134.0.196:15021/healthz/ready": dial tcp 10.134.0.196:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-dce009-5fbcf89498-c29n4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-dce009-5fbcf89498-c29n4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-dce009-5fbcf89498-c29n4

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-6bd876-openshift-default-db6f74989-6rhwz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-0f6e09-openshift-default-86b9b7746f

SuccessfulCreate

Created pod: e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

openshift-ingress

gateway_labeler_controller

e2e-explicit-0f6e09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-0f6e09

openshift-ingress

deployment-controller

e2e-explicit-0f6e09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-0f6e09-openshift-default-86b9b7746f from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-ed5ad5-openshift-default-85499958df

SuccessfulCreate

Created pod: e2e-noten-ed5ad5-openshift-default-85499958df-jmwvv

openshift-ingress

deployment-controller

e2e-noten-ed5ad5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ed5ad5-openshift-default-85499958df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-ed5ad5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ed5ad5

openshift-ingress

multus

e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-9fbc61

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-9fbc61

openshift-ingress

deployment-controller

e2e-autores-9fbc61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-9fbc61-openshift-default-55d484c997 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-9fbc61-openshift-default-55d484c997

SuccessfulCreate

Created pod: e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

openshift-ingress

kubelet

e2e-noten-ed5ad5-openshift-default-85499958df-jmwvv

Started

Container started

openshift-ingress

kubelet

e2e-noten-ed5ad5-openshift-default-85499958df-jmwvv

Created

Container created

openshift-ingress

multus

e2e-noten-ed5ad5-openshift-default-85499958df-jmwvv

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-ed5ad5-openshift-default-85499958df-jmwvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0f6e09-7dcfd6f794

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-0f6e09-7dcfd6f794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0f6e09: serviceaccount "payload-processing-e2e-explicit-0f6e09" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-0f6e09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0f6e09: serviceaccount "payload-processing-e2e-explicit-0f6e09" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-0f6e09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-0f6e09-7dcfd6f794 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-5t8r4

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0f6e09-7dcfd6f794

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-0f6e09-7dcfd6f794-zwx5q

openshift-ingress

multus

payload-processing-e2e-explicit-0f6e09-7dcfd6f794-zwx5q

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-0f6e09-7dcfd6f794-zwx5q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-5t8r4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-5t8r4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-5t8r4

openshift-ingress

kubelet

payload-processing-e2e-explicit-0f6e09-7dcfd6f794-zwx5q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-0f6e09-7dcfd6f794-zwx5q

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-5t8r4

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-9fbc61

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-9fbc61

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-9fbc61-5c7c56cb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-9fbc61-5c7c56cb6

FailedCreate

Error creating: pods "payload-processing-e2e-autores-9fbc61-5c7c56cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-9fbc61: serviceaccount "payload-processing-e2e-autores-9fbc61" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-9fbc61: serviceaccount "payload-processing-e2e-autores-9fbc61" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-c6zd9

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-9fbc61-5c7c56cb6

SuccessfulCreate

Created pod: payload-processing-e2e-autores-9fbc61-5c7c56cb6-74fcg

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-c6zd9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-c6zd9

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-c6zd9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-9fbc61-5c7c56cb6-74fcg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-c6zd9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-autores-9fbc61-5c7c56cb6-74fcg

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-9fbc61-5c7c56cb6-74fcg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-9fbc61-5c7c56cb6-74fcg

Created

Container created

opendatahub

kubelet

test-curl-7564-e4c772

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7564-e4c772

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7564-e4c772

Created

Container created

opendatahub

kubelet

test-curl-7564-e4c772

Started

Container started

opendatahub

kubelet

test-curl-7564-e4c772

Killing

Stopping container test-curl-7564-e4c772

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-59f957fdd7-j9gl6

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulDelete

Deleted pod: e2e-worker-w2-085566-openshift-default-9958546fc-qfsz9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-j9gl6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-wlhq8

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-ghh87

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-db5198

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-db5198
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-ed5ad5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-a-db5198-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-db5198-openshift-default-6bfbb87b9c from 0 to 1

openshift-ingress

multus

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-ed5ad5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c

SuccessfulCreate

Created pod: e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 8 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-dce009-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qstfd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-dce009-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-db5198

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-db5198-666565cf58 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-db5198

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-db5198: serviceaccount "payload-processing-e2e-extmod-a-db5198" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-db5198-666565cf58

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-db5198-666565cf58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-db5198: serviceaccount "payload-processing-e2e-extmod-a-db5198" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-db5198-666565cf58

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-db5198-666565cf58-659tp

openshift-ingress

kubelet

e2e-noten-ed5ad5-openshift-default-85499958df-jmwvv

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-extmod-a-db5198-666565cf58-659tp

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-db5198-666565cf58-659tp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-db5198-666565cf58-659tp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-db5198-666565cf58-659tp

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dv4kx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-dhjv5

openshift-ingress

deployment-controller

e2e-shared-a-w0-ba89e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc from 2 to 3

openshift-ingress

replicaset-controller

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc

SuccessfulCreate

Created pod: e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ba89e0-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

Created

Container created
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 10 to 8

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-05473b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-05473b

openshift-ingress

replicaset-controller

e2e-extmod-b-05473b-openshift-default-5d6455945

SuccessfulCreate

Created pod: e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

openshift-ingress

deployment-controller

e2e-extmod-b-05473b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-05473b-openshift-default-5d6455945 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-96w8x

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-05473b-7ff86fff6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-05473b-7ff86fff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-05473b: serviceaccount "payload-processing-e2e-extmod-b-05473b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-05473b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-05473b-7ff86fff6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-05473b-7ff86fff6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-05473b-7ff86fff6-wtw2t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-05473b: serviceaccount "payload-processing-e2e-extmod-b-05473b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-05473b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-b-05473b-7ff86fff6-wtw2t

AddedInterface

Add eth0 [10.132.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-05473b-7ff86fff6-wtw2t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-05473b-7ff86fff6-wtw2t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-05473b-7ff86fff6-wtw2t

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh

AddedInterface

Add eth0 [10.132.1.2/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-6e5139-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6e5139-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5

SuccessfulCreate

Created pod: e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-hqdq9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-p2vp7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 10 to 8

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

ProbeError

Startup probe error: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulDelete

Deleted pod: e2e-worker-w2-085566-openshift-default-9958546fc-vjgvl
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

Unhealthy

Startup probe failed: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-085566-openshift-default-9958546fc from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

(combined from similar events): New size: 5; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-db5198-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-db5198-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-b-421604-openshift-default-6f64b459b5

SuccessfulCreate

Created pod: e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

openshift-ingress

deployment-controller

e2e-extmod-b-421604-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-421604-openshift-default-6f64b459b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-421604

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-421604

openshift-ingress

multus

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

AddedInterface

Add eth0 [10.132.1.6/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-421604-85fcf48bcb

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-421604-85fcf48bcb-rjhqj

openshift-ingress

replicaset-controller

e2e-autores-9fbc61-openshift-default-55d484c997

SuccessfulCreate

Created pod: e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-421604

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-421604-85fcf48bcb from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-9fbc61-openshift-default-55d484c997

SuccessfulCreate

Created pod: e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

openshift-ingress

replicaset-controller

e2e-autores-9fbc61-openshift-default-55d484c997

SuccessfulCreate

Created pod: e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-421604

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-421604: serviceaccount "payload-processing-e2e-extmod-b-421604" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9fbc61-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-421604-85fcf48bcb

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-421604-85fcf48bcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-421604: serviceaccount "payload-processing-e2e-extmod-b-421604" not found

openshift-ingress

deployment-controller

e2e-autores-9fbc61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-9fbc61-openshift-default-55d484c997 from 1 to 4

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

Started

Container started

openshift-ingress

multus

e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

AddedInterface

Add eth0 [10.132.1.7/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

Started

Container started

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

Created

Container created

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

Created

Container created

openshift-ingress

multus

e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

AddedInterface

Add eth0 [10.132.1.8/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-421604-85fcf48bcb-rjhqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-421604-85fcf48bcb-rjhqj

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

Created

Container created

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-421604-85fcf48bcb-rjhqj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-421604-85fcf48bcb-rjhqj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

Unhealthy

Readiness probe failed: Get "http://10.133.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

ProbeError

Readiness probe error: Get "http://10.133.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

ProbeError

Readiness probe error: Get "http://10.134.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

Started

Container started

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

Unhealthy

Readiness probe failed: Get "http://10.134.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c

SuccessfulCreate

Created pod: e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

openshift-ingress

deployment-controller

e2e-extmod-a-d8d0fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d8d0fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d8d0fa

openshift-ingress

multus

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

ProbeError

Startup probe error: Get "http://10.132.1.8:15021/healthz/ready": dial tcp 10.132.1.8:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

Unhealthy

Startup probe failed: Get "http://10.132.1.8:15021/healthz/ready": dial tcp 10.132.1.8:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

ProbeError

Startup probe error: Get "http://10.132.1.7:15021/healthz/ready": dial tcp 10.132.1.7:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

Unhealthy

Startup probe failed: Get "http://10.132.1.7:15021/healthz/ready": dial tcp 10.132.1.7:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

ProbeError

Startup probe error: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

Unhealthy

Startup probe failed: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d8d0fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d8d0fa: serviceaccount "payload-processing-e2e-extmod-a-d8d0fa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d8d0fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d8d0fa: serviceaccount "payload-processing-e2e-extmod-a-d8d0fa" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk

AddedInterface

Add eth0 [10.132.1.12/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9fbc61-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9fbc61-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-db5198-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-db5198-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-explicit-0f6e09-7dcfd6f794-zwx5q

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9fbc61-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9fbc61-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0f6e09-6dfbd9b95f-5t8r4

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-0f6e09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-0f6e09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-03c633

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-03c633

openshift-ingress

deployment-controller

e2e-extmod-b-03c633-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-03c633-openshift-default-58bd8ddf77 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-03c633-openshift-default-58bd8ddf77

SuccessfulCreate

Created pod: e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

openshift-ingress

multus

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9fbc61-6c795d7dc9-c6zd9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-9fbc61-5c7c56cb6-74fcg

Killing

Stopping container payload-processing
(x11)

openshift-ingress

kubelet

e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

Unhealthy

Startup probe failed: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

ProbeError

Startup probe error: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

Unhealthy

Startup probe failed: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

ProbeError

Startup probe error: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-03c633

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-03c633-69568b484c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-03c633

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-03c633-bf68b8f86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-03c633-bf68b8f86

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-03c633-bf68b8f86-2bgg6
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-03c633-bf68b8f86

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-03c633-bf68b8f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-03c633: serviceaccount "payload-processing-e2e-extmod-b-03c633" not found
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-03c633-69568b484c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-03c633-69568b484c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-03c633: serviceaccount "payload-processing-e2e-extmod-b-03c633" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-03c633-69568b484c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb

AddedInterface

Add eth0 [10.132.1.14/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-03c633-bf68b8f86-2bgg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-03c633-bf68b8f86-2bgg6

AddedInterface

Add eth0 [10.132.1.15/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-03c633-bf68b8f86-2bgg6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-03c633-bf68b8f86-2bgg6

Started

Container started

openshift-ingress

kubelet

e2e-explicit-0f6e09-openshift-default-86b9b7746f-wltkp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-37aa95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-37aa95

openshift-ingress

deployment-controller

e2e-extmod-a-37aa95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-37aa95-openshift-default-75559b5549 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-37aa95-openshift-default-75559b5549

SuccessfulCreate

Created pod: e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

openshift-ingress

multus

e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

AddedInterface

Add eth0 [10.132.1.16/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-37aa95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-37aa95: serviceaccount "payload-processing-e2e-extmod-a-37aa95" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-37aa95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-37aa95-68669fc94d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-37aa95-68669fc94d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-37aa95-68669fc94d-867j7
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-37aa95-68669fc94d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-37aa95-68669fc94d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-37aa95: serviceaccount "payload-processing-e2e-extmod-a-37aa95" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-37aa95-68669fc94d-867j7

AddedInterface

Add eth0 [10.132.1.17/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-37aa95-68669fc94d-867j7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-37aa95-68669fc94d-867j7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-37aa95-68669fc94d-867j7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq

Started

Container started

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-w7zk9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-65cfr

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-05473b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-n46jz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

ProbeError

Readiness probe error: Get "http://10.132.1.6:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-05473b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-autores-9fbc61-openshift-default-55d484c997-7t9gv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

Unhealthy

Readiness probe failed: Get "http://10.132.1.6:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-extmod-a-14ebbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-14ebbb-openshift-default-56b94b45bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf

SuccessfulCreate

Created pod: e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-14ebbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-14ebbb

openshift-ingress

multus

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

AddedInterface

Add eth0 [10.132.1.19/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-03c633-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-03c633-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-14ebbb: serviceaccount "payload-processing-e2e-extmod-a-14ebbb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-14ebbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-s9rdw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-14ebbb: serviceaccount "payload-processing-e2e-extmod-a-14ebbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-14ebbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-s9rdw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-s9rdw

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-s9rdw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-s9rdw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

Unhealthy

Startup probe failed: Get "http://10.132.1.6:15021/healthz/ready": dial tcp 10.132.1.6:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

ProbeError

Startup probe error: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

Unhealthy

Startup probe failed: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

ProbeError

Startup probe error: Get "http://10.132.1.6:15021/healthz/ready": dial tcp 10.132.1.6:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d8d0fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d8d0fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-421604-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-421604-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-c7aecb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-c7aecb

openshift-ingress

replicaset-controller

e2e-extmod-b-c7aecb-openshift-default-c8cf956df

SuccessfulCreate

Created pod: e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

openshift-ingress

deployment-controller

e2e-extmod-b-c7aecb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-c7aecb-openshift-default-c8cf956df from 0 to 1

openshift-ingress

multus

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

AddedInterface

Add eth0 [10.132.1.21/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-14ebbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-14ebbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-c7aecb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-c7aecb-6868956579 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-c7aecb: serviceaccount "payload-processing-e2e-extmod-b-c7aecb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-c7aecb-5974bf759b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-c7aecb-5974bf759b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-c7aecb: serviceaccount "payload-processing-e2e-extmod-b-c7aecb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-c7aecb-5974bf759b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-c7aecb-5974bf759b-ggb9m

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-c7aecb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-c7aecb-5974bf759b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq
(x6)

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c7aecb-5974bf759b-ggb9m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq

AddedInterface

Add eth0 [10.132.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c7aecb-5974bf759b-ggb9m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c7aecb-5974bf759b-ggb9m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-c7aecb-5974bf759b-ggb9m

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d8d0fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d8d0fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-421604-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-421604-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-6350b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-6350b9-openshift-default-54dcdbf56f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-6350b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-6350b9

openshift-ingress

replicaset-controller

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f

SuccessfulCreate

Created pod: e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

openshift-ingress

multus

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-6350b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6350b9: serviceaccount "payload-processing-e2e-extmod-b-6350b9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-6350b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-6350b9-5c98f9f596 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6350b9-5c98f9f596

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-6350b9-5c98f9f596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6350b9: serviceaccount "payload-processing-e2e-extmod-b-6350b9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6350b9-5c98f9f596

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-6350b9-5c98f9f596-58rw6

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6350b9-5c98f9f596-58rw6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-6350b9-5c98f9f596-58rw6

AddedInterface

Add eth0 [10.132.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6350b9-5c98f9f596-58rw6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6350b9-5c98f9f596-58rw6

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-05473b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-05473b-openshift-default-5d6455945 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-05473b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-05473b-openshift-default-5d6455945

SuccessfulCreate

Created pod: e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

Started

Container started

openshift-ingress

multus

e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-03c633-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-03c633-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

ProbeError

Startup probe error: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

Unhealthy

Startup probe failed: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-c7aecb-openshift-default-c8cf956df

SuccessfulCreate

Created pod: e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-c7aecb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-c7aecb-openshift-default-c8cf956df from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c7aecb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

ProbeError

Startup probe error: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

Unhealthy

Startup probe failed: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

Unhealthy

Startup probe failed: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

ProbeError

Startup probe error: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-421604-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-421604-openshift-default-6f64b459b5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-421604-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-421604-openshift-default-6f64b459b5

SuccessfulCreate

Created pod: e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

Created

Container created

openshift-ingress

multus

e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c7aecb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c7aecb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

ProbeError

Readiness probe error: Get "http://10.134.0.215:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

Unhealthy

Readiness probe failed: Get "http://10.134.0.215:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

Unhealthy

Startup probe failed: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

ProbeError

Startup probe error: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 8 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-88msw

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6350b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6350b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-59f957fdd7 from 9 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-59f957fdd7-nj4bc

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-546kv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-nj4bc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-p2bj5

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 8 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-9thpz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 7 to 6

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-b4nvw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 10 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-d9jk4

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-h898b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wgvpt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 10 to 6

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-g58hq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-92mq7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-5pv87

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-ncqdq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-rnvr6

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 8 to 6

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-dmc6x

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-xcx8r

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

ProbeError

Startup probe error: Get "http://10.132.1.16:15021/healthz/ready": dial tcp 10.132.1.16:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

Unhealthy

Startup probe failed: Get "http://10.132.1.16:15021/healthz/ready": dial tcp 10.132.1.16:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-37aa95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-37aa95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-37aa95-openshift-default-75559b5549

SuccessfulCreate

Created pod: e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-37aa95-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-37aa95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-37aa95-openshift-default-75559b5549 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

ProbeError

Startup probe error: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

Unhealthy

Startup probe failed: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-b-03c633-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-03c633-openshift-default-58bd8ddf77 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-03c633-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-03c633-openshift-default-58bd8ddf77

SuccessfulCreate

Created pod: e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

Created

Container created

openshift-ingress

multus

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

AddedInterface

Add eth0 [10.132.1.47/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

ProbeError

Startup probe error: Get "http://10.132.1.19:15021/healthz/ready": dial tcp 10.132.1.19:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

Unhealthy

Startup probe failed: Get "http://10.132.1.19:15021/healthz/ready": dial tcp 10.132.1.19:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

ProbeError

Startup probe error: Get "http://10.132.1.47:15021/healthz/ready": dial tcp 10.132.1.47:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

Unhealthy

Startup probe failed: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

ProbeError

Startup probe error: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

Unhealthy

Startup probe failed: Get "http://10.132.1.47:15021/healthz/ready": dial tcp 10.132.1.47:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-14ebbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-14ebbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-dce009-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-dce009-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-6484f5959b

FailedCreate

Error creating: pods "payload-processing-external-model-6484f5959b-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6484f5959b from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-6484f5959b

SuccessfulCreate

Created pod: payload-processing-external-model-6484f5959b-6ftn9

models-as-a-service

multus

payload-processing-external-model-6484f5959b-6ftn9

AddedInterface

Add eth0 [10.132.1.55/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6484f5959b-6ftn9

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6484f5959b-6ftn9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6484f5959b-6ftn9

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-a-w0-ba89e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc from 3 to 2

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-8cqkn

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ba89e0-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-rvtk9

Killing

Stopping container istio-proxy

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

AddedInterface

Add eth0 [10.132.1.67/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-dtftr

AddedInterface

Add eth0 [10.132.1.66/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-k6ntj

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-dtftr
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6484f5959b-6ftn9

Killing

Stopping container payload-processing
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-555d99b548

FailedCreate

Error creating: pods "payload-processing-external-model-555d99b548-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-555d99b548

SuccessfulCreate

Created pod: payload-processing-external-model-555d99b548-7jhqb

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-555d99b548 from 0 to 1
(x3)

models-as-a-service

kubelet

payload-processing-external-model-555d99b548-7jhqb

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-b8fdb8e61542" not found
(x3)

models-as-a-service

kubelet

payload-processing-external-model-555d99b548-7jhqb

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-9f8dm" : failed to fetch token: serviceaccounts "payload-processing-external-model" not found
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

Unhealthy

Startup probe failed: Get "http://10.132.1.66:15021/healthz/ready": dial tcp 10.132.1.66:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

Unhealthy

Startup probe failed: Get "http://10.132.1.67:15021/healthz/ready": dial tcp 10.132.1.67:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

ProbeError

Startup probe error: Get "http://10.132.1.66:15021/healthz/ready": dial tcp 10.132.1.66:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

ProbeError

Startup probe error: Get "http://10.132.1.67:15021/healthz/ready": dial tcp 10.132.1.67:15021: connect: connection refused body:
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-555d99b548

FailedCreate

Error creating: pods "payload-processing-external-model-555d99b548-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-555d99b548 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-555d99b548

SuccessfulCreate

Created pod: payload-processing-external-model-555d99b548-t5mdw

models-as-a-service

kubelet

payload-processing-external-model-555d99b548-t5mdw

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-555d99b548-t5mdw

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-555d99b548-t5mdw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-555d99b548-t5mdw

AddedInterface

Add eth0 [10.132.1.75/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-555d99b548-t5mdw

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-598bd85469

SuccessfulCreate

Created pod: payload-processing-external-model-598bd85469-hbkd8

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-598bd85469 from 0 to 1
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-598bd85469

FailedCreate

Error creating: pods "payload-processing-external-model-598bd85469-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

multus

payload-processing-external-model-598bd85469-hbkd8

AddedInterface

Add eth0 [10.132.1.82/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-598bd85469-hbkd8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-598bd85469-hbkd8

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-598bd85469-hbkd8

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-598bd85469-hbkd8

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-a-3d4fe2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-3d4fe2

openshift-ingress

deployment-controller

e2e-inf-a-3d4fe2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-3d4fe2-openshift-default-656d7c868c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-3d4fe2-openshift-default-656d7c868c

SuccessfulCreate

Created pod: e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

openshift-ingress

multus

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

AddedInterface

Add eth0 [10.132.1.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-3d4fe2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm

AddedInterface

Add eth0 [10.132.1.88/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3d4fe2: serviceaccount "payload-processing-e2e-inf-a-3d4fe2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3d4fe2: serviceaccount "payload-processing-e2e-inf-a-3d4fe2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-3d4fe2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj

AddedInterface

Add eth0 [10.132.1.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-6cfb9f578f

SuccessfulCreate

Created pod: payload-processing-external-model-6cfb9f578f-8m4nb
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-6cfb9f578f

FailedCreate

Error creating: pods "payload-processing-external-model-6cfb9f578f-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6cfb9f578f from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-6cfb9f578f-8m4nb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6cfb9f578f-8m4nb

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6cfb9f578f-8m4nb

Created

Container created

models-as-a-service

multus

payload-processing-external-model-6cfb9f578f-8m4nb

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6cfb9f578f-8m4nb

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-inf-a-8c6934-openshift-default-86d87fffbf

SuccessfulCreate

Created pod: e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

openshift-ingress

deployment-controller

e2e-inf-a-8c6934-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-8c6934-openshift-default-86d87fffbf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-8c6934

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-8c6934

openshift-ingress

multus

e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

AddedInterface

Add eth0 [10.132.1.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8c6934-587f859b95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-8c6934

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-8c6934-587f859b95 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-8c6934

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-8c6934-7d5b684686 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8c6934-587f859b95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-8c6934-587f859b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8c6934: serviceaccount "payload-processing-e2e-inf-a-8c6934" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8c6934-7d5b684686

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-8c6934-7d5b684686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8c6934: serviceaccount "payload-processing-e2e-inf-a-8c6934" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8c6934-7d5b684686

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf

AddedInterface

Add eth0 [10.134.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9

SuccessfulCreate

Created pod: e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

openshift-ingress

deployment-controller

e2e-inf-b-c94fdf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c94fdf-openshift-default-74b9bc76b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c94fdf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c94fdf

openshift-ingress

multus

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

AddedInterface

Add eth0 [10.132.1.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c94fdf-6877495847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c94fdf-6877495847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c94fdf-6877495847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c94fdf: serviceaccount "payload-processing-e2e-inf-b-c94fdf" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q

AddedInterface

Add eth0 [10.134.0.230/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c94fdf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c94fdf-6877495847 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c94fdf-65977c7758

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c94fdf-65977c7758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c94fdf: serviceaccount "payload-processing-e2e-inf-b-c94fdf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c94fdf-65977c7758

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c94fdf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c94fdf-65977c7758 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-b-f5afd7-openshift-default-f54dc7459

SuccessfulCreate

Created pod: e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f5afd7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f5afd7

openshift-ingress

deployment-controller

e2e-inf-b-f5afd7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f5afd7-openshift-default-f54dc7459 from 0 to 1

openshift-ingress

multus

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f5afd7: serviceaccount "payload-processing-e2e-inf-b-f5afd7" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f5afd7: serviceaccount "payload-processing-e2e-inf-b-f5afd7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f5afd7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f5afd7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f5afd7-5b66cf75dd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm

AddedInterface

Add eth0 [10.134.0.231/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq

AddedInterface

Add eth0 [10.134.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8c6934-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8c6934-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

ProbeError

Startup probe error: Get "http://10.132.1.90:15021/healthz/ready": dial tcp 10.132.1.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

Unhealthy

Startup probe failed: Get "http://10.132.1.90:15021/healthz/ready": dial tcp 10.132.1.90:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

ProbeError

Startup probe error: Get "http://10.132.1.87:15021/healthz/ready": dial tcp 10.132.1.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

Unhealthy

Startup probe failed: Get "http://10.132.1.87:15021/healthz/ready": dial tcp 10.132.1.87:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3d4fe2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3d4fe2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8c6934-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8c6934-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3d4fe2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3d4fe2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

Unhealthy

Startup probe failed: Get "http://10.132.1.91:15021/healthz/ready": dial tcp 10.132.1.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

ProbeError

Startup probe error: Get "http://10.132.1.91:15021/healthz/ready": dial tcp 10.132.1.91:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c94fdf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c94fdf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

ProbeError

Readiness probe error: Get "http://10.133.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

Unhealthy

Readiness probe failed: Get "http://10.133.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-a-3d4fe2-openshift-default-656d7c868c

SuccessfulCreate

Created pod: e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3d4fe2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-3d4fe2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-3d4fe2-openshift-default-656d7c868c from 1 to 2

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

Unhealthy

Startup probe failed: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

ProbeError

Startup probe error: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f5afd7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f5afd7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c94fdf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c94fdf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

Unhealthy

Startup probe failed: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

ProbeError

Startup probe error: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-8vnp7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-085566-openshift-default-9958546fc from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulDelete

Deleted pod: e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-x8tpw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-7rvj4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-db5198-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-db5198-openshift-default-6bfbb87b9c from 1 to 2

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 6 to 5

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-db5198-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c

SuccessfulCreate

Created pod: e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-cw225

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 6 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

multus

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

AddedInterface

Add eth0 [10.132.1.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-72ddv

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-xcm8s
(x5)

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

ProbeError

Startup probe error: Get "http://10.132.1.119:15021/healthz/ready": dial tcp 10.132.1.119:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

Unhealthy

Startup probe failed: Get "http://10.132.1.119:15021/healthz/ready": dial tcp 10.132.1.119:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f5afd7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f5afd7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-2gzr4

openshift-ingress

deployment-controller

e2e-inf-a-bf7965-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-bf7965-openshift-default-79fb49f54f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-bf7965

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-bf7965

openshift-ingress

replicaset-controller

e2e-inf-a-bf7965-openshift-default-79fb49f54f

SuccessfulCreate

Created pod: e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

openshift-ingress

multus

e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

AddedInterface

Add eth0 [10.132.1.121/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bf7965-548c4c7466

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-bf7965-548c4c7466-mmstj
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bf7965-548c4c7466

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-bf7965-548c4c7466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bf7965: serviceaccount "payload-processing-e2e-inf-a-bf7965" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-bf7965

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-bf7965-55f8f68699 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bf7965: serviceaccount "payload-processing-e2e-inf-a-bf7965" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-bf7965

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-bf7965-548c4c7466 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bf7965-548c4c7466-mmstj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr

AddedInterface

Add eth0 [10.134.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bf7965-548c4c7466-mmstj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bf7965-548c4c7466-mmstj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-bf7965-548c4c7466-mmstj

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 5 to 4

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-f9zzk

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-qd4f4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fx92h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-inf-b-d7c7fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d7c7fd-openshift-default-658887fd8c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d7c7fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d7c7fd

openshift-ingress

replicaset-controller

e2e-inf-b-d7c7fd-openshift-default-658887fd8c

SuccessfulCreate

Created pod: e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

openshift-ingress

multus

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

AddedInterface

Add eth0 [10.132.1.127/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d7c7fd-79cb4b758d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-lvs8q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d7c7fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d7c7fd: serviceaccount "payload-processing-e2e-inf-b-d7c7fd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d7c7fd-79cb4b758d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d7c7fd: serviceaccount "payload-processing-e2e-inf-b-d7c7fd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d7c7fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d7c7fd-79cb4b758d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7

AddedInterface

Add eth0 [10.132.1.128/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-lvs8q

AddedInterface

Add eth0 [10.132.1.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-lvs8q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-lvs8q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-lvs8q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4d63cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4d63cd

openshift-ingress

replicaset-controller

e2e-inf-a-4d63cd-openshift-default-58dc4588dc

SuccessfulCreate

Created pod: e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

openshift-ingress

deployment-controller

e2e-inf-a-4d63cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4d63cd-openshift-default-58dc4588dc from 0 to 1

openshift-ingress

multus

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

AddedInterface

Add eth0 [10.132.1.130/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4d63cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4d63cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4d63cd-6f5ccff788 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4d63cd-6f5ccff788

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4d63cd-6f5ccff788-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4d63cd: serviceaccount "payload-processing-e2e-inf-a-4d63cd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4d63cd: serviceaccount "payload-processing-e2e-inf-a-4d63cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4d63cd-6f5ccff788

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4d63cd-6f5ccff788-zcr98

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d63cd-6f5ccff788-zcr98

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-4d63cd-6f5ccff788-zcr98

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d63cd-6f5ccff788-zcr98

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d63cd-6f5ccff788-zcr98

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh

AddedInterface

Add eth0 [10.134.0.242/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d7c7fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d7c7fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8c6934-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-8c6934-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-8c6934-openshift-default-86d87fffbf from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-a-8c6934-openshift-default-86d87fffbf

SuccessfulCreate

Created pod: e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

Started

Container started

openshift-ingress

multus

e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

ProbeError

Startup probe error: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

Unhealthy

Startup probe failed: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4d63cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4d63cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

Unhealthy

Readiness probe failed: Get "http://10.132.1.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

ProbeError

Readiness probe error: Get "http://10.132.1.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-inf-b-519a78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-519a78

openshift-ingress

deployment-controller

e2e-inf-b-519a78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-519a78-openshift-default-5d4d979b7f from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-519a78-openshift-default-5d4d979b7f

SuccessfulCreate

Created pod: e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

openshift-ingress

multus

e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

ProbeError

Startup probe error: Get "http://10.132.1.127:15021/healthz/ready": dial tcp 10.132.1.127:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

Unhealthy

Startup probe failed: Get "http://10.132.1.127:15021/healthz/ready": dial tcp 10.132.1.127:15021: connect: connection refused
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-519a78-6dc895887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-519a78-6dc895887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-519a78: serviceaccount "payload-processing-e2e-inf-b-519a78" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-519a78-6dc895887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-519a78-f84b65d4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-519a78-f84b65d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-519a78: serviceaccount "payload-processing-e2e-inf-b-519a78" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-519a78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-519a78-f84b65d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-519a78-f84b65d4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-519a78-f84b65d4-dqlbq

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-519a78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-519a78-6dc895887 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-519a78-f84b65d4-dqlbq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-519a78-f84b65d4-dqlbq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-519a78-f84b65d4-dqlbq

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-519a78-f84b65d4-dqlbq

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d7c7fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-59f957fdd7-k6ntj
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d7c7fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-59f957fdd7 from 10 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-k6ntj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-519a78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-519a78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

ProbeError

Readiness probe error: Get "http://10.132.1.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

Unhealthy

Readiness probe failed: Get "http://10.132.1.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

ProbeError

Startup probe error: Get "http://10.132.1.121:15021/healthz/ready": dial tcp 10.132.1.121:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

ProbeError

Startup probe error: Get "http://10.132.1.130:15021/healthz/ready": dial tcp 10.132.1.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

Unhealthy

Startup probe failed: Get "http://10.132.1.121:15021/healthz/ready": dial tcp 10.132.1.121:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

Unhealthy

Startup probe failed: Get "http://10.132.1.130:15021/healthz/ready": dial tcp 10.132.1.130:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-bf7965-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-bf7965-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4d63cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4d63cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-bf7965-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-bf7965-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-ks68q

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-hjlhz

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-lv9vr

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-inf-a-4d63cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4d63cd-openshift-default-58dc4588dc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4d63cd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-a-4d63cd-openshift-default-58dc4588dc

SuccessfulCreate

Created pod: e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

openshift-ingress

multus

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

AddedInterface

Add eth0 [10.134.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

ProbeError

Startup probe error: Get "http://10.134.0.246:15021/healthz/ready": dial tcp 10.134.0.246:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

Unhealthy

Startup probe failed: Get "http://10.134.0.246:15021/healthz/ready": dial tcp 10.134.0.246:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-519a78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-519a78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d4fe2-59fb4cccd4-zp7tm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d4fe2-687c688c79-g64pj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-inf-a-745c52

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-745c52

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-745c52-openshift-default-846f6fbb79

SuccessfulCreate

Created pod: e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-kqghk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-745c52-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-745c52-openshift-default-846f6fbb79 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 4 to 3

openshift-ingress

multus

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

AddedInterface

Add eth0 [10.132.1.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-ssm7m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-745c52: serviceaccount "payload-processing-e2e-inf-a-745c52" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-745c52

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-745c52-5fc5bbf548 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-745c52

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-745c52-6478d48b6c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-745c52-5fc5bbf548

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-745c52-5fc5bbf548-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-745c52: serviceaccount "payload-processing-e2e-inf-a-745c52" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-745c52-5fc5bbf548

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-745c52-5fc5bbf548-gcdzj

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm

openshift-ingress

kubelet

payload-processing-e2e-inf-a-745c52-5fc5bbf548-gcdzj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-745c52-5fc5bbf548-gcdzj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-745c52-5fc5bbf548-gcdzj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-745c52-5fc5bbf548-gcdzj

AddedInterface

Add eth0 [10.134.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-xp42m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-3d4fe2-openshift-default-656d7c868c-k5ljr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-c94fdf-openshift-default-74b9bc76b9-rggnw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-dvv8q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-8c6934-openshift-default-86d87fffbf-ms6km

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c94fdf-65977c7758-rdb5q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c94fdf-6877495847-s5mkn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8c6934-7d5b684686-lcrhq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8c6934-587f859b95-ggbjf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f5afd7-5b66cf75dd-bfpsq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f5afd7-f649d9cb7-9xtxm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-inf-b-5ecee8-openshift-default-8684dc5955

SuccessfulCreate

Created pod: e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

openshift-ingress

deployment-controller

e2e-inf-b-5ecee8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5ecee8-openshift-default-8684dc5955 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5ecee8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5ecee8

openshift-ingress

multus

e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

AddedInterface

Add eth0 [10.132.1.142/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-pt86g

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-pt86g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-pt86g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-pt86g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-pt86g

AddedInterface

Add eth0 [10.132.1.143/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5ecee8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5ecee8: serviceaccount "payload-processing-e2e-inf-b-5ecee8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5ecee8: serviceaccount "payload-processing-e2e-inf-b-5ecee8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5ecee8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-ghl9k

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78

AddedInterface

Add eth0 [10.134.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-ghl9k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-ghl9k

AddedInterface

Add eth0 [10.134.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-ghl9k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-ghl9k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

ProbeError

Readiness probe error: Get "http://10.132.1.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

Unhealthy

Readiness probe failed: Get "http://10.132.1.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-f5afd7-openshift-default-f54dc7459-sct9n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

Created

Container created
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-pt86g

ProbeError

Startup probe error: Get "http://10.132.1.143:15021/healthz/ready": dial tcp 10.132.1.143:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-pt86g

Unhealthy

Startup probe failed: Get "http://10.132.1.143:15021/healthz/ready": dial tcp 10.132.1.143:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

Unhealthy

Startup probe failed: Get "http://10.132.1.140:15021/healthz/ready": dial tcp 10.132.1.140:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

ProbeError

Startup probe error: Get "http://10.132.1.140:15021/healthz/ready": dial tcp 10.132.1.140:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-745c52-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-745c52-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-745c52-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-745c52-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

Unhealthy

Startup probe failed: Get "http://10.132.1.142:15021/healthz/ready": dial tcp 10.132.1.142:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

ProbeError

Startup probe error: Get "http://10.132.1.142:15021/healthz/ready": dial tcp 10.132.1.142:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 3 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-rr5jm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kpfn4

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-9z8mb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5ecee8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5ecee8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-fdpng

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5ecee8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5ecee8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bf7965-548c4c7466-mmstj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bf7965-55f8f68699-w4gkr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-bf7965-openshift-default-79fb49f54f-96h4z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d7c7fd-79cb4b758d-lvs8q

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7c7fd-5797dbc64c-mb9x7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-d7c7fd-openshift-default-658887fd8c-5cn4m

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-f3a4c29a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f3a4c29a-openshift-default-b65b8b6c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7

SuccessfulCreate

Created pod: e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

openshift-ingress

gateway_labeler_controller

e2e-mt-f3a4c29a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f3a4c29a

openshift-ingress

multus

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

AddedInterface

Add eth0 [10.134.0.252/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f3a4c29a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f3a4c29a-797bbf59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f3a4c29a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f3a4c29a-846f96f786 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f3a4c29a-797bbf59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f3a4c29a: serviceaccount "payload-processing-e2e-mt-f3a4c29a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f3a4c29a-846f96f786

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f3a4c29a-846f96f786-f546k
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f3a4c29a-846f96f786

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f3a4c29a-846f96f786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f3a4c29a: serviceaccount "payload-processing-e2e-mt-f3a4c29a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f3a4c29a-797bbf59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-5cpvm

openshift-ingress

multus

payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-5cpvm

AddedInterface

Add eth0 [10.132.1.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-f3a4c29a-846f96f786-f546k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-5cpvm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-f3a4c29a-846f96f786-f546k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-f3a4c29a-846f96f786-f546k

AddedInterface

Add eth0 [10.132.1.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-5cpvm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-5cpvm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-f3a4c29a-846f96f786-f546k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d63cd-6f5ccff788-zcr98

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f3a4c29a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f3a4c29a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-hxpl8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-4d63cd-openshift-default-58dc4588dc-5zn4x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-519a78-f84b65d4-dqlbq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d63cd-5d7fdcb7cf-ktxzh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-519a78-openshift-default-5d4d979b7f-h8w2h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

Unhealthy

Startup probe failed: Get "http://10.134.0.252:15021/healthz/ready": dial tcp 10.134.0.252:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

ProbeError

Startup probe error: Get "http://10.134.0.252:15021/healthz/ready": dial tcp 10.134.0.252:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-519a78-6dc895887-8l54v

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.245:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-vjdk2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f3a4c29a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f3a4c29a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

ProbeError

Readiness probe error: Get "http://10.132.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

Unhealthy

Readiness probe failed: Get "http://10.132.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-extmod-a-37aa95-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-37aa95-openshift-default-75559b5549 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-37aa95-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-37aa95-openshift-default-75559b5549

SuccessfulDelete

Deleted pod: e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-085566-openshift-default-9958546fc from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulDelete

Deleted pod: e2e-worker-w2-085566-openshift-default-9958546fc-929nt

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-h8nqn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-929nt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-extmod-b-03c633-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-03c633-openshift-default-58bd8ddf77 from 2 to 1
(x5)

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulDelete

Deleted pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-hwznh

openshift-ingress

replicaset-controller

e2e-extmod-b-03c633-openshift-default-58bd8ddf77

SuccessfulDelete

Deleted pod: e2e-extmod-b-03c633-openshift-default-58bd8ddf77-flz49

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-03c633-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-x8ffs

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-x8ffs

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-wnwcx

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6e5139-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w3-6e5139-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-421604-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-421604-openshift-default-6f64b459b5

SuccessfulDelete

Deleted pod: e2e-extmod-b-421604-openshift-default-6f64b459b5-hdbl7

openshift-ingress

deployment-controller

e2e-extmod-b-421604-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-421604-openshift-default-6f64b459b5 from 2 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-f3a4c29a-846f96f786-f546k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f3a4c29a-797bbf59-5cpvm

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-extmod-a-db5198-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-db5198-openshift-default-6bfbb87b9c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-db5198-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c

SuccessfulDelete

Deleted pod: e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-zzph9

openshift-ingress

kubelet

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f3a4c29a-openshift-default-b65b8b6c7-sp7qg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47

SuccessfulCreate

Created pod: e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

openshift-ingress

deployment-controller

e2e-shared-a-w2-63fde4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-63fde4-openshift-default-7765d5df47 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-63fde4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-63fde4

openshift-ingress

multus

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-63fde4: serviceaccount "payload-processing-e2e-shared-a-w2-63fde4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-63fde4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-63fde4: serviceaccount "payload-processing-e2e-shared-a-w2-63fde4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-63fde4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-63fde4-cc696dd64 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-c7aecb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-c7aecb-openshift-default-c8cf956df from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c7aecb-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-c7aecb-openshift-default-c8cf956df

SuccessfulDelete

Deleted pod: e2e-extmod-b-c7aecb-openshift-default-c8cf956df-7rr92

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-05473b-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-05473b-openshift-default-5d6455945

SuccessfulDelete

Deleted pod: e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

openshift-ingress

deployment-controller

e2e-extmod-b-05473b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-05473b-openshift-default-5d6455945 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-b9tll

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-bab2c3-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w3-bab2c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-bab2c3-openshift-default-748796c95 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bab2c3-openshift-default-748796c95

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-47xhn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-twsx2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w4-30e9de-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-30e9de-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-f58z9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4f93d1-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-4f93d1-openshift-default-66d47948fc

SuccessfulDelete

Deleted pod: e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd
(x4)

openshift-ingress

deployment-controller

e2e-worker-w3-4f93d1-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-4f93d1-openshift-default-66d47948fc from 3 to 2

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-8v2qd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-3c25bf-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-3c25bf-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-88w74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-745c52-5fc5bbf548-gcdzj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8d0fa-c45cbd755-tsgmk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-3bcc2b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-3bcc2b

openshift-ingress

deployment-controller

e2e-shared-b-w2-3bcc2b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459

SuccessfulCreate

Created pod: e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8d0fa-5ffccdcf8-d6x9j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-3bcc2b: serviceaccount "payload-processing-e2e-shared-b-w2-3bcc2b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-3bcc2b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-3bcc2b: serviceaccount "payload-processing-e2e-shared-b-w2-3bcc2b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-3bcc2b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6

AddedInterface

Add eth0 [10.132.1.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47

AddedInterface

Add eth0 [10.132.1.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-63fde4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-63fde4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-d8d0fa-openshift-default-69f67bf7c-kvvkh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-03c633-bf68b8f86-2bgg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-745c52-openshift-default-846f6fbb79-j87c6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-745c52-6478d48b6c-5lprm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5ecee8-5bcc57bdb4-ghl9k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-03c633-69568b484c-b9xqb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-03c633-openshift-default-58bd8ddf77-8wbqp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-5ecee8-openshift-default-8684dc5955-mvt99

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-3c25bf-664f9598-fzb5f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-3c25bf-6cdf4f84c9-r8rrz

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-63fde4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-63fde4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ecee8-677dd698bc-xfv78

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-3c25bf-openshift-default-7d78cb5b9c-wf2rg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-30e9de-54f79c474b-dh4jg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-30e9de-6d499fc695-gjhzn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

ProbeError

Readiness probe error: Get "http://10.133.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

Unhealthy

Readiness probe failed: Get "http://10.133.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-30e9de-openshift-default-cbd59dfb5-4kx4s

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

Unhealthy

Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

ProbeError

Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-466f83-5fcfcc9947-m6r7p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-466f83-79cb4b6b8-5ph2j

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-3bcc2b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-3bcc2b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-466f83-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-466f83-openshift-default-5559865c55

SuccessfulCreate

Created pod: e2e-worker-w4-466f83-openshift-default-5559865c55-r628m
(x4)

openshift-ingress

deployment-controller

e2e-worker-w4-466f83-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w4-466f83-openshift-default-5559865c55 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

Started

Container started

openshift-ingress

multus

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulDelete

Deleted pod: e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-085566-openshift-default-9958546fc from 3 to 2

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-b6km9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

ProbeError

Startup probe error: Get "http://10.134.1.1:15021/healthz/ready": dial tcp 10.134.1.1:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

Unhealthy

Startup probe failed: Get "http://10.134.1.1:15021/healthz/ready": dial tcp 10.134.1.1:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-lszn7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-r628m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-466f83-openshift-default-5559865c55-x49b2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-dce009-5fbcf89498-c29n4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-dce009-openshift-default-57db6cbb9c-dpz2j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-05473b-7ff86fff6-wtw2t

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-dce009-748986cfc5-hbbvn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

multus

test-curl-7573-5618ac

AddedInterface

Add eth0 [10.132.1.184/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7573-5618ac

Started

Container started

opendatahub

kubelet

test-curl-7573-5618ac

Created

Container created

opendatahub

kubelet

test-curl-7573-5618ac

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7573-d81fc0

Started

Container started

opendatahub

multus

test-curl-7573-d81fc0

AddedInterface

Add eth0 [10.132.1.185/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7573-d81fc0

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-05473b-openshift-default-5d6455945-mkxsl

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7573-d81fc0

Created

Container created

opendatahub

kubelet

test-curl-7573-5618ac

Killing

Stopping container test-curl-7573-5618ac
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-05473b-5bb56bc4ff-jn7hh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

kubelet

test-curl-7573-d81fc0

Killing

Stopping container test-curl-7573-d81fc0

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7a92d4-84cccb45f5-5bgqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7a92d4-d6d6b6c84-w9rlb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-7a92d4-openshift-default-6cff4dfcbc-splnb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-08a7bc-859d5b9d86-s56vz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-08a7bc-76646b7d95-hvfxj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-08a7bc-openshift-default-5864477cc-5k4kb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-59f957fdd7-pt86g

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-59f957fdd7-dtftr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-pt86g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-59f957fdd7 from 10 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-59f957fdd7-ksr77

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-dtftr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-ksr77

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14ebbb-5fb74ff66d-s9rdw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b13a14-7df99d5455-qf9ww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b13a14-6bb746df8d-fps9m

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-14ebbb-openshift-default-56b94b45bf-jtjkh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6350b9-5c98f9f596-58rw6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b13a14-openshift-default

SuccessfulRescale

(combined from similar events): New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-b13a14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b13a14-openshift-default-5dbd78dd47 from 2 to 4

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14ebbb-59c4847995-lw7xq

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.213:50052" within 1s: context deadline exceeded

openshift-ingress

replicaset-controller

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47

SuccessfulCreate

Created pod: e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

AddedInterface

Add eth0 [10.132.1.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-6350b9-openshift-default-54dcdbf56f-47flm

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

ProbeError

Startup probe error: Get "http://10.134.1.2:15021/healthz/ready": dial tcp 10.134.1.2:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

Unhealthy

Startup probe failed: Get "http://10.134.1.2:15021/healthz/ready": dial tcp 10.134.1.2:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

ProbeError

Startup probe error: Get "http://10.132.1.194:15021/healthz/ready": dial tcp 10.132.1.194:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

Unhealthy

Startup probe failed: Get "http://10.132.1.194:15021/healthz/ready": dial tcp 10.132.1.194:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-8vhj7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-bfg8v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w1-b13a14-openshift-default-dockercfg-r6zzp); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w1-b13a14-openshift-default-dockercfg-r6zzp); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bab2c3-5b846bbb44-nxgfd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bab2c3-54f4bddb5f-lkjxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-sssz5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b13a14-openshift-default-5dbd78dd47-m2pnc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kgcck

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-kgcck
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6350b9-77957cc74c-bp8th

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-bab2c3-openshift-default-748796c95-kc2h6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6e5139-6c59cfcd75-nt27p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6e5139-84b6cc5c8-88znp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-6e5139-openshift-default-76fb6699b5-5ktbz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-63fde4-openshift-default-7765d5df47-c2b6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4f93d1-79f8f9b54b-7j9mc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4f93d1-794f67f74c-f5gbf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-63fde4-cc696dd64-rfnsd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-63fde4-7cf975855f-z7z9t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-3bcc2b-openshift-default-8d8447459-mhhvx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-37aa95-68669fc94d-867j7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bcc2b-55b9879487-nxpb6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bcc2b-6dfd5ddd8d-9lx47

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-37aa95-openshift-default-75559b5549-5mpvh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c7aecb-5974bf759b-ggb9m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-59f957fdd7 from 7 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-59f957fdd7-w9chd

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-k8hpp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c7aecb-6868956579-h9vjq

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.1.22:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4f93d1-openshift-default-66d47948fc-9dm5d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37aa95-f58cfd595-9vdqq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-w9chd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-c7aecb-openshift-default-c8cf956df-mfdxm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-db5198-666565cf58-659tp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-085566-64777db978-9bjqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-db5198-openshift-default-6bfbb87b9c-mlmrc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-085566-bd6dc9bc5-dwwdc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-421604-85fcf48bcb-rjhqj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-db5198-6dd79d66c5-cjn4g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-421604-openshift-default-6f64b459b5-rckhk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-085566-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

openshift-ingress

replicaset-controller

e2e-worker-w2-085566-openshift-default-9958546fc

SuccessfulCreate

Created pod: e2e-worker-w2-085566-openshift-default-9958546fc-hl29q
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-085566-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-085566-openshift-default-9958546fc from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-hl29q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-hl29q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-hl29q

Created

Container created

openshift-ingress

multus

e2e-worker-w2-085566-openshift-default-9958546fc-hl29q

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-hl29q

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-hl29q

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-hl29q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-mvc69

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-tbzkz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-085566-openshift-default-9958546fc-djgdm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-421604-7f8cfcd7c9-8fh4r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-m5mhs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-ba89e0-openshift-default-797cbf55cc-vqnp6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-bw8tp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-99a8fe-openshift-default-579f8df677-vx5bf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ba89e0-67cd8fb495-sh56n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ba89e0-588b9fcb6b-wmqkw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f3631f-5bc8d4db88-nmljn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f3631f-56fd5dd755-l86cc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-99a8fe-7c69f5ccf-cqg2p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-99a8fe-69d4c86766-drnt7

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.178:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f3631f-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

deployment-controller

e2e-worker-w0-f3631f-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w0-f3631f-openshift-default-c7bbc899 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-f3631f-openshift-default-c7bbc899

SuccessfulCreate

Created pod: e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-5bfwv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wcctc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f3631f-openshift-default-c7bbc899-wh2nk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-4deb62c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4deb62c4

openshift-ingress

replicaset-controller

e2e-ait-4deb62c4-openshift-default-794b645577

SuccessfulCreate

Created pod: e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

openshift-ingress

deployment-controller

e2e-ait-4deb62c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4deb62c4-openshift-default-794b645577 from 0 to 1

openshift-ingress

multus

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4deb62c4-57bbb6f6db

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4deb62c4-57bbb6f6db-jxhx6

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4deb62c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4deb62c4-57bbb6f6db from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4deb62c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-gpvg8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4deb62c4-57bbb6f6db

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4deb62c4-57bbb6f6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4deb62c4: serviceaccount "payload-processing-e2e-ait-4deb62c4" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4deb62c4: serviceaccount "payload-processing-e2e-ait-4deb62c4" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-gpvg8

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4deb62c4-57bbb6f6db-jxhx6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-gpvg8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-gpvg8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-gpvg8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-4deb62c4-57bbb6f6db-jxhx6

AddedInterface

Add eth0 [10.134.1.5/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4deb62c4-57bbb6f6db-jxhx6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-4deb62c4-57bbb6f6db-jxhx6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

ProbeError

Startup probe error: Get "http://10.134.1.3:15021/healthz/ready": dial tcp 10.134.1.3:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-59f957fdd7-947bh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-947bh

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

Unhealthy

Startup probe failed: Get "http://10.134.1.3:15021/healthz/ready": dial tcp 10.134.1.3:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-59f957fdd7 from 6 to 5

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4deb62c4-5967b55f9f-gpvg8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4deb62c4-57bbb6f6db-jxhx6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4deb62c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4deb62c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

Killing

Stopping container istio-proxy

opendatahub

replicaset-controller

maas-controller-687b69bd9

SuccessfulDelete

Deleted pod: maas-controller-687b69bd9-6n6dr

opendatahub

kubelet

maas-controller-687b69bd9-6n6dr

Killing

Stopping container manager

openshift-ingress

kubelet

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-4deb62c4-openshift-default-794b645577-9plzn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

replicaset-controller

maas-controller-687b69bd9

SuccessfulCreate

Created pod: maas-controller-687b69bd9-q5zvz

opendatahub

kubelet

maas-controller-687b69bd9-q5zvz

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:9702bbc56ba2e9645109470392d2aedc9f80832a5241a1bc0d1c556ce8c352a5"

opendatahub

multus

maas-controller-687b69bd9-q5zvz

AddedInterface

Add eth0 [10.134.1.6/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-687b69bd9-q5zvz

Started

Container started

opendatahub

kubelet

maas-controller-687b69bd9-q5zvz

Created

Container created

opendatahub

kubelet

maas-controller-687b69bd9-q5zvz

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:9702bbc56ba2e9645109470392d2aedc9f80832a5241a1bc0d1c556ce8c352a5" in 496ms (497ms including waiting). Image size: 200095241 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

AddedInterface

Add eth0 [10.134.1.7/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-xvscb

AddedInterface

Add eth0 [10.132.1.206/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 5 to 9

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

AddedInterface

Add eth0 [10.132.1.205/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-xvscb

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-h8zwm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-xfwgr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-7wgtr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

Created

Container created

opendatahub

maas-controller-687b69bd9-q5zvz_6f1c7334-adb4-4fc0-9f80-1a38d8897279

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-687b69bd9-q5zvz_6f1c7334-adb4-4fc0-9f80-1a38d8897279 became leader
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

ProbeError

Startup probe error: Get "http://10.134.1.7:15021/healthz/ready": dial tcp 10.134.1.7:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

Unhealthy

Startup probe failed: Get "http://10.134.1.7:15021/healthz/ready": dial tcp 10.134.1.7:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

Unhealthy

Startup probe failed: Get "http://10.132.1.206:15021/healthz/ready": dial tcp 10.132.1.206:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

ProbeError

Startup probe error: Get "http://10.132.1.206:15021/healthz/ready": dial tcp 10.132.1.206:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

Unhealthy

Startup probe failed: Get "http://10.132.1.205:15021/healthz/ready": dial tcp 10.132.1.205:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

ProbeError

Startup probe error: Get "http://10.132.1.205:15021/healthz/ready": dial tcp 10.132.1.205:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

ProbeError

Startup probe error: Get "http://10.134.1.7:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

Unhealthy

Startup probe failed: Get "http://10.134.1.7:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

Unhealthy

Startup probe failed: Get "http://10.132.1.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

ProbeError

Startup probe error: Get "http://10.132.1.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

ProbeError

Startup probe error: Get "http://10.132.1.206:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

Unhealthy

Startup probe failed: Get "http://10.132.1.206:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

AddedInterface

Add eth0 [10.134.1.8/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-bnt6k
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 9 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

Created

Container created

opendatahub

replicaset-controller

maas-controller-687b69bd9

SuccessfulDelete

Deleted pod: maas-controller-687b69bd9-q5zvz
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-687b69bd9 from 1 to 0

opendatahub

kubelet

maas-controller-687b69bd9-q5zvz

Killing

Stopping container manager
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-687b69bd9 from 0 to 1

opendatahub

replicaset-controller

maas-controller-687b69bd9

SuccessfulCreate

Created pod: maas-controller-687b69bd9-hmtjv

opendatahub

kubelet

maas-controller-687b69bd9-hmtjv

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:9702bbc56ba2e9645109470392d2aedc9f80832a5241a1bc0d1c556ce8c352a5"

opendatahub

multus

maas-controller-687b69bd9-hmtjv

AddedInterface

Add eth0 [10.134.1.9/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-687b69bd9-hmtjv

Created

Container created

opendatahub

kubelet

maas-controller-687b69bd9-hmtjv

Started

Container started

opendatahub

kubelet

maas-controller-687b69bd9-hmtjv

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:9702bbc56ba2e9645109470392d2aedc9f80832a5241a1bc0d1c556ce8c352a5" in 416ms (416ms including waiting). Image size: 200095241 bytes.
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

ProbeError

Startup probe error: Get "http://10.134.1.8:15021/healthz/ready": dial tcp 10.134.1.8:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

Unhealthy

Startup probe failed: Get "http://10.134.1.8:15021/healthz/ready": dial tcp 10.134.1.8:15021: connect: connection refused

opendatahub

maas-controller-687b69bd9-hmtjv_a9700d5f-47b4-4f61-b6e8-acbd0efbbefe

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-687b69bd9-hmtjv_a9700d5f-47b4-4f61-b6e8-acbd0efbbefe became leader

models-as-a-service

replicaset-controller

payload-processing-external-model-657df65587

SuccessfulCreate

Created pod: payload-processing-external-model-657df65587-bkr92
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-657df65587

FailedCreate

Error creating: pods "payload-processing-external-model-657df65587-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-657df65587 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-657df65587-bkr92

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-657df65587-bkr92

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-657df65587-bkr92

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-657df65587-bkr92

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-657df65587-bkr92

Killing

Stopping container payload-processing

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.RoleBinding llm/e2e-prio-pool-0704dddb-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.Service llm/e2e-prio-pool-0704dddb-kserve-workload-svc

llm

deployment-controller

e2e-prio-pool-0704dddb-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.Role llm/e2e-prio-pool-0704dddb-epp-role

llm

replicaset-controller

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c

SuccessfulCreate

Created pod: e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-0704dddb-epp-auth-rb

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.ServiceAccount llm/e2e-prio-pool-0704dddb-epp-sa

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.Deployment llm/e2e-prio-pool-0704dddb-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.Secret llm/e2e-prio-pool-0704dddb-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.Service llm/e2e-prio-pool-0704dddb-epp-service

llm

multus

e2e-prio-pool-0704dddb-kserve-8b5c668dd-pmbhz

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

Created v1.Deployment llm/e2e-prio-pool-0704dddb-kserve-router-scheduler

llm

replicaset-controller

e2e-prio-pool-0704dddb-kserve-8b5c668dd

SuccessfulCreate

Created pod: e2e-prio-pool-0704dddb-kserve-8b5c668dd-pmbhz

llm

deployment-controller

e2e-prio-pool-0704dddb-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-0704dddb-kserve-8b5c668dd from 0 to 1

llm

kubelet

e2e-prio-pool-0704dddb-kserve-8b5c668dd-pmbhz

Started

Container started

llm

kubelet

e2e-prio-pool-0704dddb-kserve-8b5c668dd-pmbhz

Created

Container created

llm

kubelet

e2e-prio-pool-0704dddb-kserve-8b5c668dd-pmbhz

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

multus

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

AddedInterface

Add eth0 [10.134.1.10/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-0704dddb-kserve-route
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-0704dddb-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

Created

Container created

llm

kubelet

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 1.768s (1.768s including waiting). Image size: 184206420 bytes.

llm

kubelet

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Updated

Updated v1.Secret llm/e2e-prio-pool-0704dddb-kserve-self-signed-certs

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9pwj7

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-9pwj7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-0704dddb] is Ready

llm

LLMInferenceServiceController

e2e-prio-pool-0704dddb

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-0704dddb-epp-auth-rb

llm

kubelet

e2e-prio-pool-0704dddb-kserve-8b5c668dd-pmbhz

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

Killing

Stopping container main

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-debeb1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-debeb1

openshift-ingress

deployment-controller

e2e-worker-single-main-debeb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69

SuccessfulCreate

Created pod: e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

openshift-ingress

multus

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-debeb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-debeb1-85975f44f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-debeb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-debeb1-74694d5f47 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-debeb1-74694f98m5

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-debeb1-85975f44fl4wb4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-debeb1-74694d5f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-debeb1-74694d5f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-debeb1: serviceaccount "payload-processing-e2e-worker-single-main-debeb1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-debeb1-74694f98m5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-debeb1-85975f44fl4wb4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-debeb1-74694f98m5

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-debeb1-85975f44f8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-debeb1-85975f44fl4wb4

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-debeb1-74694f98m5

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-debeb1-74694d5f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-debeb1-74694f98m5

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-debeb1-85975f44fl4wb4

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-debeb1-85975f44f8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-debeb1-85975f44f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-debeb1: serviceaccount "payload-processing-e2e-worker-single-main-debeb1" not found

openshift-ingress

multus

payload-processing-e2e-worker-single-main-debeb1-85975f44fl4wb4

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-debeb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-debeb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

Unhealthy

Readiness probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

Created

Container created

openshift-ingress

kubelet

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

ProbeError

Readiness probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

ProbeError

Startup probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

Unhealthy

Startup probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused
(x5)

llm

kubelet

e2e-prio-pool-0704dddb-kserve-router-scheduler-58d56f94c-ft5gv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-debeb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-debeb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-debeb1-74694f98m5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-debeb1-85975f44fl4wb4

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-debeb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-debeb1-74694d5f47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-debeb1-85975f44f8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-debeb1-85975f44fghb8m

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-debeb1-74694d5f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-debeb1-74694c9ldp

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-debeb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-debeb1-85975f44f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-debeb1-74694d5f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-debeb1-74694d5f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-debeb1: serviceaccount "payload-processing-e2e-worker-single-main-debeb1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-debeb1-85975f44f8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-debeb1-85975f44f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-debeb1: serviceaccount "payload-processing-e2e-worker-single-main-debeb1" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-debeb1-85975f44fghb8m

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-debeb1-74694c9ldp

AddedInterface

Add eth0 [10.134.1.12/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-debeb1-74694c9ldp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-debeb1-85975f44fghb8m

AddedInterface

Add eth0 [10.134.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-debeb1-85975f44fghb8m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-debeb1-74694c9ldp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-debeb1-85975f44fghb8m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-debeb1-74694c9ldp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-debeb1-74694c9ldp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-debeb1-85975f44fghb8m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-debeb1-openshift-default-7c4bd87c69trz2g

Killing

Stopping container istio-proxy

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-29948937-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Created

Created v1.PodMonitor llm/e2e-same-id-a-29948937-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Created

Created v1.PodMonitor llm/e2e-same-id-a-29948937-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Created

Created v1.DestinationRule llm/e2e-same-id-a-29948937-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Created

Created v1.Deployment llm/e2e-same-id-a-29948937-kserve

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Created

Created v1.Service llm/e2e-same-id-a-29948937-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Created

Created v1.Secret llm/e2e-same-id-a-29948937-kserve-self-signed-certs

llm

deployment-controller

e2e-same-id-a-29948937-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-29948937-kserve-85d88f7bb9 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Created

Created v1.HTTPRoute llm/e2e-same-id-a-29948937-kserve-route

llm

replicaset-controller

e2e-same-id-a-29948937-kserve-85d88f7bb9

SuccessfulCreate

Created pod: e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv

llm

kubelet

e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv

Started

Container started

llm

multus

e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv

AddedInterface

Add eth0 [10.134.1.14/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv

Created

Container created

llm

kubelet

e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

Updated

Updated v1.Secret llm/e2e-same-id-a-29948937-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-29948937] is Ready

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Created

Created v1.Secret llm/e2e-same-id-b-29948937-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Created

Created v1.HTTPRoute llm/e2e-same-id-b-29948937-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Created

Created v1.Service llm/e2e-same-id-b-29948937-kserve-workload-svc

llm

deployment-controller

e2e-same-id-b-29948937-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-29948937-kserve-5bff757f8f from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-29948937-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Created

Created v1.PodMonitor llm/e2e-same-id-b-29948937-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Created

Created v1.PodMonitor llm/e2e-same-id-b-29948937-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Created

Created v1.Deployment llm/e2e-same-id-b-29948937-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Created

Created v1.DestinationRule llm/e2e-same-id-b-29948937-kserve-workload-svc

llm

replicaset-controller

e2e-same-id-b-29948937-kserve-5bff757f8f

SuccessfulCreate

Created pod: e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc

llm

kubelet

e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc

Created

Container created

llm

multus

e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc

AddedInterface

Add eth0 [10.134.1.15/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc

Started

Container started

llm

kubelet

e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

Updated

Updated v1.Secret llm/e2e-same-id-b-29948937-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-29948937] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-29948937

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-29948937 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-29948937; safe to ignore if traffic splitting is planned
(x8)

llm

LLMInferenceServiceController

e2e-same-id-b-29948937

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-29948937 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-29948937; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc

Killing

Stopping container main

llm

kubelet

e2e-same-id-a-29948937-kserve-85d88f7bb9-j5ztv

Unhealthy

Readiness probe failed: Get "https://10.134.1.14:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-same-id-b-29948937-kserve-5bff757f8f-gs2sc

Unhealthy

Readiness probe failed: Get "https://10.134.1.15:8000/ready": dial tcp 10.134.1.15:8000: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-99f95578b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-99f95578b

SuccessfulCreate

Created pod: payload-pre-processing-99f95578b-gg9x5

openshift-ingress

kubelet

payload-pre-processing-99f95578b-gg9x5

Created

Container created

openshift-ingress

multus

payload-pre-processing-99f95578b-gg9x5

AddedInterface

Add eth0 [10.134.1.16/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-99f95578b-gg9x5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-99f95578b-gg9x5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-7rjf5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-7rjf5

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-57dd5dc5bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-57dd5dc5bc

SuccessfulCreate

Created pod: payload-processing-57dd5dc5bc-7z6kd

openshift-ingress

multus

payload-processing-57dd5dc5bc-7z6kd

AddedInterface

Add eth0 [10.134.1.17/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-57dd5dc5bc-7z6kd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-57dd5dc5bc-7z6kd

Created

Container created

openshift-ingress

kubelet

payload-processing-57dd5dc5bc-7z6kd

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-7bb9489676

SuccessfulDelete

Deleted pod: payload-processing-7bb9489676-xx9xb

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-7bb9489676 from 1 to 0

openshift-ingress

kubelet

payload-processing-7bb9489676-xx9xb

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-7dc89df4c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-7dc89df4c4

SuccessfulCreate

Created pod: payload-processing-7dc89df4c4-hhqqf

openshift-ingress

kubelet

payload-pre-processing-5556d898cf-4gn6l

Started

Container started

openshift-ingress

kubelet

payload-processing-7dc89df4c4-hhqqf

Started

Container started

openshift-ingress

kubelet

payload-processing-7dc89df4c4-hhqqf

Created

Container created

openshift-ingress

kubelet

payload-processing-7dc89df4c4-hhqqf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-5556d898cf

SuccessfulCreate

Created pod: payload-pre-processing-5556d898cf-4gn6l

openshift-ingress

multus

payload-processing-7dc89df4c4-hhqqf

AddedInterface

Add eth0 [10.134.1.18/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-5556d898cf-4gn6l

Created

Container created

openshift-ingress

multus

payload-pre-processing-5556d898cf-4gn6l

AddedInterface

Add eth0 [10.134.1.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-5556d898cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-5556d898cf-4gn6l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-7bb9489676-xx9xb

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.31:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-57dd5dc5bc from 1 to 0

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-99f95578b from 1 to 0

openshift-ingress

kubelet

payload-processing-57dd5dc5bc-7z6kd

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-99f95578b

SuccessfulDelete

Deleted pod: payload-pre-processing-99f95578b-gg9x5

openshift-ingress

kubelet

payload-pre-processing-99f95578b-gg9x5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-57dd5dc5bc

SuccessfulDelete

Deleted pod: payload-processing-57dd5dc5bc-7z6kd

models-as-a-service

replicaset-controller

payload-processing-external-model-7fd6967f4c

SuccessfulCreate

Created pod: payload-processing-external-model-7fd6967f4c-gwsc4

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7fd6967f4c from 0 to 1
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-7fd6967f4c

FailedCreate

Error creating: pods "payload-processing-external-model-7fd6967f4c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-gwsc4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7fd6967f4c-gwsc4

AddedInterface

Add eth0 [10.134.1.20/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-gwsc4

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-gwsc4

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-gwsc4

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-7fd6967f4c-gwsc4

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.1.20:50052" within 1s: context deadline exceeded
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gqpt8

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-d9b592

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-d9b592

openshift-ingress

deployment-controller

e2e-worker-single-main-d9b592-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-d9b592-openshift-default-c7d56c589 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-d9b592-openshift-default-c7d56c589

SuccessfulCreate

Created pod: e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

openshift-ingress

multus

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

AddedInterface

Add eth0 [10.134.1.21/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-d9b592

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-d9b592-5f5dfc877d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-d9b592-5f5dfc877d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-d9b592: serviceaccount "payload-processing-e2e-worker-single-main-d9b592" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9b58ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-d9b592-68fc9b58ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-d9b592: serviceaccount "payload-processing-e2e-worker-single-main-d9b592" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9b58ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-d9b592

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-d9b592-68fc9b58ff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2

AddedInterface

Add eth0 [10.134.1.23/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl

AddedInterface

Add eth0 [10.134.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

ProbeError

Readiness probe error: Get "http://10.134.1.21:15021/healthz/ready": read tcp 10.134.0.2:46166->10.134.1.21:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

Unhealthy

Readiness probe failed: Get "http://10.134.1.21:15021/healthz/ready": read tcp 10.134.0.2:46166->10.134.1.21:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

ProbeError

Startup probe error: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

Unhealthy

Startup probe failed: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-d9b592-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-d9b592-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc965dz2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877px9vl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-d9b592

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-d9b592-5f5dfc877d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9b58ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-d9b592-68fc9b58ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-d9b592: serviceaccount "payload-processing-e2e-worker-single-main-d9b592" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877ccj5v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9tkwmg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9tkwmg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9tkwmg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9tkwmg

AddedInterface

Add eth0 [10.134.1.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-d9b592-5f5dfc877ccj5v
(x3)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-d9b592-5f5dfc877d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-d9b592: serviceaccount "payload-processing-e2e-worker-single-main-d9b592" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9b58ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-d9b592-68fc9tkwmg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-d9b592

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-d9b592-68fc9b58ff from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877ccj5v

AddedInterface

Add eth0 [10.134.1.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877ccj5v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877ccj5v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-d9b592-68fc9tkwmg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-d9b592-5f5dfc877ccj5v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-d9b592-openshift-default-c7d56c589-zz2lv

Killing

Stopping container istio-proxy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-k4psh

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-k4psh

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-9p95v

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-9p95v

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-9p95v

AddedInterface

Add eth0 [10.134.1.29/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-9p95v

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-9p95v

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 7.8s (7.8s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-9p95v

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-9p95v_f46a4174-c3c6-4ae3-8732-81d5e4dcf244

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-9p95v_f46a4174-c3c6-4ae3-8732-81d5e4dcf244 became leader
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

Unhealthy

Readiness probe failed: Get "http://10.134.1.7:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

ProbeError

Readiness probe error: Get "http://10.132.1.206:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

Unhealthy

Readiness probe failed: Get "http://10.132.1.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-h8zwm

ProbeError

Readiness probe error: Get "http://10.132.1.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xvscb

Unhealthy

Readiness probe failed: Get "http://10.132.1.206:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6bhmr

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

Unhealthy

Readiness probe failed: Get "http://10.133.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-7wgtr

ProbeError

Readiness probe error: Get "http://10.133.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xfwgr

ProbeError

Readiness probe error: Get "http://10.134.1.7:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-cd5ll

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-jbqn5

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-qq2td

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

Unhealthy

Readiness probe failed: Get "http://10.134.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-bnt6k

ProbeError

Readiness probe error: Get "http://10.134.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: