Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg to ip-10-0-142-133.us-east-2.compute.internal

ai-tenants

e2e-api-a-a976bc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-a976bc: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-cd2738

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-cd2738: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-11f0a3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-11f0a3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-2129b9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-2129b9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-3568c5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-3568c5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-935086

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-935086: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-4ea582

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-4ea582: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-23a657

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-23a657: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-36a991

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-36a991: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-42d786

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-42d786: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-5ec436

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-5ec436: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-807c08

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-807c08: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-a8e574

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-a8e574: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-1ef96f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-1ef96f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-2db162

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-2db162: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-327608

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-327608: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-5c3c1f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-5c3c1f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-bee8f6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-bee8f6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-22dfc1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-22dfc1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-2966e7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-2966e7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-312f21

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-312f21: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-50b3a6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-50b3a6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-78383f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-78383f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-06644b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-06644b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-0b0610

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-0b0610: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-63be7a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-63be7a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-658b8c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-658b8c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-cc0b41

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-cc0b41: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-4c9298

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-4c9298: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-6098d0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-6098d0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-82b305

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-82b305: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-d1fc77

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-d1fc77: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-8f7957

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-8f7957: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-c8832b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-c8832b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-dd1cba

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-dd1cba: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-eda8e2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-eda8e2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-8a098971

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-8a098971: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-da5f07e6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-da5f07e6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-4e6649

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-4e6649: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-7dbdb8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-7dbdb8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-d8e217

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-d8e217: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-dfd356

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-dfd356: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-e4fdc1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-e4fdc1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-009a5f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-009a5f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-4a5f09

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-4a5f09: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-56e6db

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-56e6db: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-6f78de

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-6f78de: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-e198eb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-e198eb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-1e2281

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-1e2281: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-b6b6f4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-b6b6f4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-86f5f0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-86f5f0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-0f0baf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-0f0baf: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-47e1c2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-47e1c2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-7771bf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-7771bf: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-2961d5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-2961d5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-b1a788

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-b1a788: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-72f605

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-72f605: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-9165c3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-9165c3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-4b97c6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-4b97c6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-24cfb6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-24cfb6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-66eed1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-66eed1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-a37cf0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-a37cf0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-77f103

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-77f103: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-ztqjp

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-ztqjp to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7341-31ce46

Scheduled

Successfully assigned opendatahub/test-curl-7341-31ce46 to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7347-4cf539

Scheduled

Successfully assigned opendatahub/test-curl-7347-4cf539 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-5lphd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-5lphd to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-rkb6z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-rkb6z to ip-10-0-141-169.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-zqnb2

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-zqnb2 to ip-10-0-141-169.us-east-2.compute.internal

opendatahub

test-curl-7347-8ca5b6

Scheduled

Successfully assigned opendatahub/test-curl-7347-8ca5b6 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7347-a5f1c6

Scheduled

Successfully assigned opendatahub/test-curl-7347-a5f1c6 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-868a2ee9-74bd97d5b7-s2x52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-868a2ee9-74bd97d5b7-s2x52 to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-2wms8

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-2wms8 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-b6kzh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-b6kzh to ip-10-0-135-5.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-h95t4

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-h95t4 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7347-e38d82

Scheduled

Successfully assigned opendatahub/test-curl-7347-e38d82 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-935086-79d69586ff-9lls5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-935086-79d69586ff-9lls5 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7350-046cae

Scheduled

Successfully assigned opendatahub/test-curl-7350-046cae to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-4q597

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-4q597 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-jzvcm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-jzvcm to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7350-25a722

Scheduled

Successfully assigned opendatahub/test-curl-7350-25a722 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-c3df6f-69769776cgjn78

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-c3df6f-69769776cgjn78 to ip-10-0-142-133.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-d7z2j

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-d7z2j to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-bw2fg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-bw2fg to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a976bc-fc44d487f-r8c2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a976bc-fc44d487f-r8c2h to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-11f0a3-c967574b7-s95gk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-11f0a3-c967574b7-s95gk to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-58970f-76bf8f9875-lfqpt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-58970f-76bf8f9875-lfqpt to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c to ip-10-0-135-5.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-4sbhs

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-4sbhs to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-nr6nl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-nr6nl to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-f7sqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-f7sqw to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-86jp4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-86jp4 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-57npd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-57npd to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-cd2738-6789f47f85-7dvjc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-cd2738-6789f47f85-7dvjc to ip-10-0-135-5.us-east-2.compute.internal

kuadrant-system

authorino-5fb64bd955-5m6ww

Scheduled

Successfully assigned kuadrant-system/authorino-5fb64bd955-5m6ww to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-bzq6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-bzq6q to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv to ip-10-0-135-5.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-fsdxw

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-fsdxw to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-935086-557dbc4555-g9w9n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-935086-557dbc4555-g9w9n to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-6szp7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-6szp7 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-868a2ee9-54664896ff-sndzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-868a2ee9-54664896ff-sndzv to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-d2zdm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-d2zdm to ip-10-0-135-5.us-east-2.compute.internal

kuadrant-system

authorino-68d65c5784-6mkqh

Scheduled

Successfully assigned kuadrant-system/authorino-68d65c5784-6mkqh to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-4ea582-59fc9c7867-7gpck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-4ea582-59fc9c7867-7gpck to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-55f9886f-76ff44474c-9k48k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-55f9886f-76ff44474c-9k48k to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b to ip-10-0-142-133.us-east-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-kgz84

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-kgz84 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r to ip-10-0-142-133.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-lx6js

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-lx6js to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-3bd024-779dd77ccrhgpb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-3bd024-779dd77ccrhgpb to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7350-2ca161

Scheduled

Successfully assigned opendatahub/test-curl-7350-2ca161 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-b7gw6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-b7gw6 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7350-4466f5

Scheduled

Successfully assigned opendatahub/test-curl-7350-4466f5 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698 to ip-10-0-135-5.us-east-2.compute.internal

opendatahub

test-curl-7350-583613

Scheduled

Successfully assigned opendatahub/test-curl-7350-583613 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-cmqs4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-cmqs4 to ip-10-0-135-5.us-east-2.compute.internal

opendatahub

maas-controller-78cc949cd9-vpjbq

Scheduled

Successfully assigned opendatahub/maas-controller-78cc949cd9-vpjbq to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-whkb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-whkb5 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-dtrzt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-dtrzt to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-rqnxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-rqnxf to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-99bb68447-w6bqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-99bb68447-w6bqc to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b to ip-10-0-142-133.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-k9mfj

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-k9mfj to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

test-curl-7350-c40f5f

Scheduled

Successfully assigned opendatahub/test-curl-7350-c40f5f to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9 to ip-10-0-135-5.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-xswfx

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-xswfx to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6 to ip-10-0-142-133.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-789486f7c8-qmfz9 to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

maas-controller-56bc685b8f-jx88t

Scheduled

Successfully assigned opendatahub/maas-controller-56bc685b8f-jx88t to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

maas-controller-56bc685b8f-572rh

Scheduled

Successfully assigned opendatahub/maas-controller-56bc685b8f-572rh to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8 to ip-10-0-142-133.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-789486f7c8-sx6g4 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz to ip-10-0-142-133.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-f74t5

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-f74t5 to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-lxmdr

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-lxmdr to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-58b55f785c-rh8fz

Scheduled

Successfully assigned openshift-ingress/payload-processing-58b55f785c-rh8fz to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7d54786449-dvg2t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7d54786449-dvg2t to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55 to ip-10-0-142-133.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-789486f7c8-xc65w

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-789486f7c8-xc65w to ip-10-0-141-169.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-hsptq

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-hsptq to ip-10-0-141-169.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-8c4p4

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-8c4p4 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-hflxn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-hflxn to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw to ip-10-0-142-133.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-f56vl

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f56vl to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg to ip-10-0-141-169.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-tfbt9

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-tfbt9 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68dd6f4fc-p5bh8

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68dd6f4fc-p5bh8 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

Scheduled

Successfully assigned openshift-ingress/e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

maas-controller-56bc685b8f-tzvbj

Scheduled

Successfully assigned opendatahub/maas-controller-56bc685b8f-tzvbj to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh to ip-10-0-142-133.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-thb2f

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-thb2f to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-nnt4m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-nnt4m to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx to ip-10-0-142-133.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-99bp7

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-99bp7 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-6f78de-86c7bb469-8wkcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-6f78de-86c7bb469-8wkcn to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl to ip-10-0-135-5.us-east-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-ljs7q

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-ljs7q to ip-10-0-135-5.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-t5dg5

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-t5dg5 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-fl8ch

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-fl8ch to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-jv8f4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-jv8f4 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-gnbw6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-gnbw6 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-kgx7c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-kgx7c to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-5hb2w

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-5hb2w to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-m6g9w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-m6g9w to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-qnbrn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-qnbrn to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp to ip-10-0-135-5.us-east-2.compute.internal

opendatahub

ai-gateway-controller-5d8dddb676-7rzb7

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5d8dddb676-7rzb7 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-mdxxk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-mdxxk to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-msm5t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-msm5t to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-56e6db-5b5876fcc-6pjkk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-56e6db-5b5876fcc-6pjkk to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-vxtkm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-vxtkm to ip-10-0-135-5.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-pd4sg

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-pd4sg to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-2h44b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-2h44b to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-gqzb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-gqzb6 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-qmxmc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-qmxmc to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-2nldm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-2nldm to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv to ip-10-0-141-169.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-r7qcl

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-r7qcl to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-7dbdb8-586545b55c-b9l8w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-7dbdb8-586545b55c-b9l8w to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-dzq7j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-dzq7j to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-4e6649-86c856c59-zc2df

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-4e6649-86c856c59-zc2df to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-a976bc-7b74756c79-mjx4z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a976bc-7b74756c79-mjx4z to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-r2rbg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-r2rbg to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-wwqcg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-da5f07e6-6f55cbb87f-wwqcg to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl to ip-10-0-142-133.us-east-2.compute.internal

opendatahub

ai-gateway-controller-56bcd69c95-g7ngq

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-56bcd69c95-g7ngq to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5 to ip-10-0-142-133.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-4pb5f to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-nnsw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-nnsw5 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-8a098971-569568574f-d27dl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8a098971-569568574f-d27dl to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-bee8f6-c879f6577-9l726

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-bee8f6-c879f6577-9l726 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-9n7b8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-9n7b8 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-4ea582-66c9c7b47f-jpjdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-4ea582-66c9c7b47f-jpjdk to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-bd7wg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-bd7wg to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-b286l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-b286l to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-eda8e2-9dc6895df-hfl69

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eda8e2-9dc6895df-hfl69 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-prio-pool-3c449aaf-kserve-b5dcbd876-v2lqp

Scheduled

Successfully assigned llm/e2e-prio-pool-3c449aaf-kserve-b5dcbd876-v2lqp to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-42d786-openshift-default-776544c777-rdssf to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-7rbsd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-7rbsd to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-8fd6h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-8fd6h to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

Scheduled

Successfully assigned llm/e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-t4wpz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-t4wpz to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c8832b-68d9664bd7-sw6ff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c8832b-68d9664bd7-sw6ff to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-6qjtx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-6qjtx to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-th4lt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-th4lt to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-5cf9f7b655-m7r89

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5cf9f7b655-m7r89 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-xk66b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-xk66b to ip-10-0-142-133.us-east-2.compute.internal

llm

e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7

Scheduled

Successfully assigned llm/e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-vbrfc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-vbrfc to ip-10-0-142-133.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-vh8nk

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-vh8nk to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-42d786-openshift-default-776544c777-97z24

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-42d786-openshift-default-776544c777-97z24 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks to ip-10-0-135-5.us-east-2.compute.internal

ai-tenants

e2e-api-a-2893d1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-2893d1: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8f7957-74f686f95b-jnvkj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8f7957-74f686f95b-jnvkj to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

ai-tenants

e2e-api-a-58970f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-58970f: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8f7957-6f59c86459-q6xln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8f7957-6f59c86459-q6xln to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-same-id-a-c03c63e2

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-c03c63e2

llm

e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq

Scheduled

Successfully assigned llm/e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-jobset-operator

jobset-controller-manager-6d9b8445f8-mbx87

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-6d9b8445f8-mbx87 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-xj2fs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-xj2fs to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-xsg9n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-xsg9n to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-tlkmj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-tlkmj to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw to ip-10-0-141-169.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-bb6976b77-pkvhn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-bb6976b77-pkvhn to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-htzj4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-htzj4 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a976bc-openshift-default-666f9d9749-njg64 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-dl596

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-dl596 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

router-default-c7d5754d7-v6znk

Scheduled

Successfully assigned openshift-ingress/router-default-c7d5754d7-v6znk to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

router-default-c7d5754d7-v6znk

FailedScheduling

no nodes available to schedule pods

llm

e2e-same-id-b-c03c63e2

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-c03c63e2

llm

e2e-same-id-b-c03c63e2

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-flgk9

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-flgk9 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-ipp-a-d1fc77-55f986b45-fp7zr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d1fc77-55f986b45-fp7zr to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-82b305-799459bc57-lsd7h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-82b305-799459bc57-lsd7h to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-5cf9f7b655-p25w5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5cf9f7b655-p25w5 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-dgh9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-dgh9n to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v to ip-10-0-135-5.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-snhcx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-snhcx to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-4hdhw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-4hdhw to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

router-default-c7d5754d7-v6znk

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-23a657-openshift-default-7db6744997-ctqqs to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-cvn56

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-cvn56 to ip-10-0-135-5.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-c8zlh

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-c8zlh to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6098d0-8579456655-vt6dq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6098d0-8579456655-vt6dq to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-fd758c546-br2db

Scheduled

Successfully assigned openshift-ingress/payload-processing-fd758c546-br2db to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-655nq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-655nq to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-4c9298-86597cb9bc-jrw44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4c9298-86597cb9bc-jrw44 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-gfrgb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-gfrgb to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-ngg2f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-ngg2f to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-63be7a-d66cc7bff-s8ggk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-63be7a-d66cc7bff-s8ggk to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4 to ip-10-0-135-5.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-xp98l

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-xp98l to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-06644b-5776d95ff9-zp5tw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-06644b-5776d95ff9-zp5tw to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-69fd6b667f-n4flb

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-69fd6b667f-n4flb to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

Scheduled

Successfully assigned openshift-ingress/e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

Scheduled

Successfully assigned openshift-ingress/e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-jhrnp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-jhrnp to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-11f0a3-956d967fc-5jjsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-11f0a3-956d967fc-5jjsj to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878 to ip-10-0-142-133.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-e4fdc1-openshift-default-8476767889-d9fkh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e4fdc1-openshift-default-8476767889-d9fkh to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-3568c5-5468488957-njxbf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3568c5-5468488957-njxbf to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-c5gdq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-c5gdq to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-api-b-935086-openshift-default-8497785c69-j2mzw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-935086-openshift-default-8497785c69-j2mzw to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-gqxkc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-gqxkc to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-wgjhv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-wgjhv to ip-10-0-142-133.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-56fb475f76-2gk4p

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-56fb475f76-2gk4p to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs to ip-10-0-142-133.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-56fb475f76-fvjmx

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-56fb475f76-fvjmx to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5 to ip-10-0-142-133.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-56fb475f76-m7d62

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-56fb475f76-m7d62 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-58970f-5d9f55f84f-vxdmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-58970f-5d9f55f84f-vxdmd to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-ptm88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-ptm88 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-z6lxr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-z6lxr to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76 to ip-10-0-135-5.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5bcd7997-smhvg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-smhvg to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-23a657-59f8bdd477-7lhz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-23a657-59f8bdd477-7lhz8 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2129b9-7485dc875f-qhrcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2129b9-7485dc875f-qhrcb to ip-10-0-142-133.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6699fcb7fd-jl6qr

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6699fcb7fd-jl6qr to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl to ip-10-0-141-169.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-695c8bf8d5-lkd8j

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-695c8bf8d5-lkd8j to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff to ip-10-0-135-5.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6f59d4c79f-g25tq

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6f59d4c79f-g25tq to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-2893d1-65f66fb94f-mfpb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2893d1-65f66fb94f-mfpb2 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-f8e1abfd-677b84899c-xcjjk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f8e1abfd-677b84899c-xcjjk to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn to ip-10-0-135-5.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6fc469f668-5rmnj

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6fc469f668-5rmnj to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz to ip-10-0-141-169.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-d58b5b6b9-n6bqb

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d58b5b6b9-n6bqb to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-x4hzs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-x4hzs to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-566nd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-566nd to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx to ip-10-0-142-133.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-75456797bd-d542n

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-75456797bd-d542n to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-msbsh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-msbsh to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-zws9j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-zws9j to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj to ip-10-0-141-169.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-769b787cbf-h9x98

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-769b787cbf-h9x98 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-3bd024-7885dfkt9h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-3bd024-7885dfkt9h to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-p2wlj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-p2wlj to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-65c448b547-wtks5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-65c448b547-wtks5 to ip-10-0-141-169.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-7875b97c67-mgttk

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7875b97c67-mgttk to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg to ip-10-0-142-133.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-7875b97c67-r8hd4

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7875b97c67-r8hd4 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-ktjtd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-ktjtd to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-tw9kl

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-tw9kl to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-c8qcb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-c8qcb to ip-10-0-142-133.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-cbbcc59d-kwr9f

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-cbbcc59d-kwr9f to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65djbrl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-c3df6f-85d65djbrl to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9 to ip-10-0-142-133.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2 to ip-10-0-141-169.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-bktgf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bktgf to ip-10-0-135-5.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-bb6976b77-7rk7g

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-bb6976b77-7rk7g to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59 to ip-10-0-135-5.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-c7d5754d7 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x2)

openshift-ingress

replicaset-controller

router-default-c7d5754d7

FailedCreate

Error creating: pods "router-default-c7d5754d7-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-c7d5754d7

SuccessfulCreate

Created pod: router-default-c7d5754d7-v6znk
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-c7d5754d7-v6znk

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-c7d5754d7-v6znk

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x2)

openshift-ingress

kubelet

router-default-c7d5754d7-v6znk

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-c7d5754d7-v6znk

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-c7d5754d7-v6znk

Started

Container started

openshift-ingress

kubelet

router-default-c7d5754d7-v6znk

Created

Container created

openshift-ingress

multus

router-default-c7d5754d7-v6znk

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-p2wlj

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-p2wlj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-p2wlj

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-p2wlj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.718s (3.718s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-p2wlj

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-p2wlj

Started

Container started

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-wtks5

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-p2wlj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-65c448b547 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-p2wlj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-69fd6b667f from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-69fd6b667f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-69fd6b667f-n4flb

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-69fd6b667f-n4flb

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-wtks5

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-69fd6b667f-n4flb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-69fd6b667f-n4flb

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-69fd6b667f-n4flb

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-69fd6b667f-n4flb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.177s (4.177s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.464s (7.464s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-xc65w

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-789486f7c8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-789486f7c8-qmfz9

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-789486f7c8-xc65w

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-789486f7c8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-789486f7c8-xc65w

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-789486f7c8-qmfz9

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-789486f7c8-sx6g4

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-789486f7c8 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-789486f7c8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-789486f7c8-sx6g4

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-h95t4

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-h95t4
(x4)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-vh8nk

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-h95t4

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.026s (3.026s including waiting). Image size: 273709574 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-vh8nk

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-xc65w

Created

Container created

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-xc65w

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-xc65w

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.93s (2.93s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Started

Container started

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vh8nk

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.743s (2.743s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-h95t4

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.075s (3.075s including waiting). Image size: 309650901 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

opendatahub-operator-controller-manager-789486f7c8-sx6g4_adb7a074-1b4b-4aaa-a847-aa6bf95c5873

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-789486f7c8-sx6g4_adb7a074-1b4b-4aaa-a847-aa6bf95c5873 became leader

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vh8nk

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.297s (2.297s including waiting). Image size: 224874686 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 575ms (575ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-qmfz9

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 471ms (471ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

install-rhknr

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-xc65w

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-xc65w

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-xc65w

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 490ms (490ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-xc65w

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-h95t4

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vh8nk

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vh8nk

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-vh8nk_2ca3786d-9351-4db8-86cd-5ca23049a21a became leader

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-h95t4

Created

Container created
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-zqnb2

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-zqnb2

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-zqnb2

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-zqnb2

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-zqnb2

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-ztqjp

cert-manager

kubelet

cert-manager-597b95cb84-ztqjp

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-597b95cb84-ztqjp

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-ztqjp

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-ztqjp

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-lx6js

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-lx6js

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-lx6js

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k9mfj

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-lx6js

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 3.479s (3.479s including waiting). Image size: 167738465 bytes.

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-k9mfj

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-lx6js

Created

Container created

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-k9mfj

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-lx6js

Started

Container started

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

authorino-operator-7b7bb4bc77-lx6js_1885af80-a343-44f3-a244-134030bd4cae

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-lx6js_1885af80-a343-44f3-a244-134030bd4cae became leader

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-ljs7q

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-ljs7q

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ljs7q

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ljs7q

Started

Container started

kuadrant-system

limitador-operator-controller-manager-5778bb4449-ljs7q_1a4a3ba7-59aa-4de7-a5d8-4db5ce7e28be

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-ljs7q_1a4a3ba7-59aa-4de7-a5d8-4db5ce7e28be became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ljs7q

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ljs7q

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.635s (1.635s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k9mfj

Started

Container started

kuadrant-system

dns-operator-controller-manager-8557cbdb84-k9mfj_4cd0d2cf-4889-4065-9c7e-fe1221b630f9

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-k9mfj_4cd0d2cf-4889-4065-9c7e-fe1221b630f9 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k9mfj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 5.643s (5.643s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k9mfj

Created

Container created

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-f56vl

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-f56vl

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f56vl

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f56vl

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f56vl

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f56vl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.028s (4.028s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-f56vl_2f850638-6c88-42c0-9411-1aea1e2fce36

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-f56vl_2f850638-6c88-42c0-9411-1aea1e2fce36 became leader

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-f74t5

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-f74t5

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-f74t5

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

kubelet

kube-auth-proxy-5cf9f7b655-m7r89

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-5cf9f7b655-m7r89

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68dd6f4fc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68dd6f4fc-p5bh8

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68dd6f4fc from 0 to 1

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-nxjmh"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

multus

kube-auth-proxy-5cf9f7b655-p25w5

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5cf9f7b655-p25w5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-ingress

replicaset-controller

kube-auth-proxy-5cf9f7b655

SuccessfulCreate

Created pod: kube-auth-proxy-5cf9f7b655-p25w5

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5cf9f7b655 from 0 to 2

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-42x6p"

openshift-ingress

replicaset-controller

kube-auth-proxy-5cf9f7b655

SuccessfulCreate

Created pod: kube-auth-proxy-5cf9f7b655-m7r89

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-99bp7

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68dd6f4fc-p5bh8

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd6f4fc-p5bh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd6f4fc-p5bh8

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd6f4fc-p5bh8

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-thb2f

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thb2f

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-thb2f

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-6d9b8445f8 from 0 to 1

kuadrant-system

multus

authorino-57f7f8659f-4sbhs

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-d7z2j

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-tfbt9

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

multus

limitador-limitador-7c9b87d574-99bp7

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-tfbt9

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-tfbt9

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-6d9b8445f8

SuccessfulCreate

Created pod: jobset-controller-manager-6d9b8445f8-mbx87

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

kuadrant-system

kubelet

authorino-57f7f8659f-4sbhs

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-4sbhs

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-99bp7

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-6d9b8445f8-mbx87

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5cf9f7b655-p25w5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.393s (2.393s including waiting). Image size: 188904677 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

kube-auth-proxy-5cf9f7b655-p25w5

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5cf9f7b655-m7r89

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.08s (3.08s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

authorino-56c6c9ddd5-d7z2j

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5cf9f7b655-m7r89

Created

Container created

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

authorino-56c6c9ddd5-d7z2j

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

kube-auth-proxy-5cf9f7b655-m7r89

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5cf9f7b655-p25w5

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-6d9b8445f8-mbx87

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-99bp7

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-99bp7

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-99bp7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.63s (2.63s including waiting). Image size: 133379307 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-tfbt9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 3.079s (3.079s including waiting). Image size: 195729000 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thb2f

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.774s (3.774s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-d7z2j

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.78s (2.78s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-d7z2j

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-d7z2j

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-4sbhs

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.686s (2.686s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-4sbhs

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-4sbhs

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thb2f

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thb2f

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-4sbhs

openshift-jobset-operator

kubelet

jobset-controller-manager-6d9b8445f8-mbx87

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-6d9b8445f8-mbx87

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.593s (3.593s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-6d9b8445f8-mbx87

Created

Container created

openshift-jobset-operator

jobset-controller-manager-6d9b8445f8-mbx87_fce62885-0f06-4e43-9de2-7632c042b423

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-6d9b8445f8-mbx87_fce62885-0f06-4e43-9de2-7632c042b423 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-4sbhs

Killing

Stopping container authorino

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thb2f

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-thb2f

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-f74t5

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-f74t5

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-f74t5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 22.171s (22.171s including waiting). Image size: 342538866 bytes.

opendatahub

kserve-module-controller-manager-7566cf5fc8-tfbt9_7f7b0ab9-0758-495a-b1c3-4ef37f28be12

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-tfbt9_7f7b0ab9-0758-495a-b1c3-4ef37f28be12 became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

maas-controller-56bc685b8f

SuccessfulCreate

Created pod: maas-controller-56bc685b8f-572rh

opendatahub

replicaset-controller

maas-controller-78cc949cd9

SuccessfulCreate

Created pod: maas-controller-78cc949cd9-vpjbq

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-78cc949cd9 from 0 to 1

opendatahub

multus

maas-controller-56bc685b8f-572rh

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

opendatahub

multus

maas-controller-78cc949cd9-vpjbq

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-78cc949cd9-vpjbq

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:1142174a4a10b8249aec3b3ffe7b075d5e2c896c81dfdc9736ba22300ff17853"

opendatahub

kubelet

maas-controller-56bc685b8f-572rh

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:1142174a4a10b8249aec3b3ffe7b075d5e2c896c81dfdc9736ba22300ff17853"

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

maas-controller-56bc685b8f-572rh

Started

Container started

opendatahub

kubelet

maas-controller-78cc949cd9-vpjbq

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:1142174a4a10b8249aec3b3ffe7b075d5e2c896c81dfdc9736ba22300ff17853" in 4.479s (4.479s including waiting). Image size: 200094710 bytes.

opendatahub

kubelet

maas-controller-56bc685b8f-572rh

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:1142174a4a10b8249aec3b3ffe7b075d5e2c896c81dfdc9736ba22300ff17853" in 4.051s (4.051s including waiting). Image size: 200094710 bytes.

opendatahub

kubelet

maas-controller-78cc949cd9-vpjbq

Created

Container created

opendatahub

kubelet

maas-controller-56bc685b8f-572rh

Created

Container created

opendatahub

kubelet

maas-controller-78cc949cd9-vpjbq

Started

Container started

opendatahub

maas-controller-56bc685b8f-572rh_0668e0a2-77ea-43ff-8dda-3f5237bb750b

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-56bc685b8f-572rh_0668e0a2-77ea-43ff-8dda-3f5237bb750b became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-xswfx

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-xswfx

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-xswfx

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

odh-model-controller-769875db56-2wms8

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-t5dg5

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

kserve-controller-manager-776cc66d47-t5dg5

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-lxmdr

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-4q597

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-4q597

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-lxmdr

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-t5dg5

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

multus

model-serving-api-75bd89fdfc-4q597

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-2wms8

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-tlkmj

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lxmdr

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-2wms8

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-tlkmj

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tlkmj

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tlkmj

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tlkmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-p2wlj

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-p2wlj

Killing

Stopping container discovery

opendatahub

kubelet

kserve-controller-manager-776cc66d47-t5dg5

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lxmdr

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-t5dg5

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lxmdr

Started

Container started

opendatahub

kubelet

maas-controller-78cc949cd9-vpjbq

Killing

Stopping container manager

opendatahub

kubelet

model-serving-api-75bd89fdfc-4q597

Started

Container started

opendatahub

replicaset-controller

maas-controller-78cc949cd9

SuccessfulDelete

Deleted pod: maas-controller-78cc949cd9-vpjbq

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lxmdr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.124s (2.124s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-4q597

Created

Container created

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-78cc949cd9 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-4q597

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.513s (2.513s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-t5dg5

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.152s (2.152s including waiting). Image size: 247676581 bytes.

opendatahub

kserve-controller-manager-776cc66d47-t5dg5_3ab815bd-df5a-4682-965b-87717fa09fd8

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-t5dg5_3ab815bd-df5a-4682-965b-87717fa09fd8 became leader

opendatahub

kubelet

odh-model-controller-769875db56-2wms8

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-2wms8

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-2wms8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.467s (3.467s including waiting). Image size: 236755567 bytes.

opendatahub

odh-model-controller-769875db56-2wms8_67261e2b-3dd9-4c2a-9c9e-22ed828d54f8

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-2wms8_67261e2b-3dd9-4c2a-9c9e-22ed828d54f8 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-lxmdr_f2d3b6a9-579d-4947-bf77-0567191276dc

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-lxmdr_f2d3b6a9-579d-4947-bf77-0567191276dc became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-xswfx

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 13.247s (13.247s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-xswfx

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-xswfx

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-kgz84

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-68d65c5784 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-fsdxw

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-kgz84

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-fsdxw

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-68d65c5784

SuccessfulCreate

Created pod: authorino-68d65c5784-6mkqh

kuadrant-system

multus

authorino-6889cbd8c4-fsdxw

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6889cbd8c4-fsdxw

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-68d65c5784-6mkqh

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-68d65c5784-6mkqh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6889cbd8c4-fsdxw

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6889cbd8c4-fsdxw

Started

Container started

kuadrant-system

kubelet

authorino-68d65c5784-6mkqh

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-fsdxw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 880ms (880ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-68d65c5784-6mkqh

Created

Container created

kuadrant-system

kubelet

authorino-68d65c5784-6mkqh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 802ms (802ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-fsdxw

Created

Container created
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

Unhealthy

Startup probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

ProbeError

Startup probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:

kuadrant-system

kubelet

authorino-56c6c9ddd5-d7z2j

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-d7z2j

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-6466c554d8-hsptq

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-hsptq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-hsptq

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-hsptq

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-hsptq

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-hsptq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 356ms (356ms including waiting). Image size: 235100981 bytes.

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-lxmdr

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lxmdr

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5d8dddb676 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulCreate

Created pod: ai-gateway-controller-5d8dddb676-7rzb7

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-7rzb7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-5d8dddb676-7rzb7

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-7rzb7

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-7rzb7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.598s (2.598s including waiting). Image size: 183979430 bytes.

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-7rzb7

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

opendatahub

ai-gateway-controller-5d8dddb676-7rzb7_a8a8e2cc-1db2-4b18-8344-ff8e187499e9

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5d8dddb676-7rzb7_a8a8e2cc-1db2-4b18-8344-ff8e187499e9 became leader

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-nnt4m

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-5hb2w
(x4)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5hb2w

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-nnt4m

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-5hb2w

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-nnt4m

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5hb2w

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5hb2w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.361s (2.361s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5hb2w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-nnt4m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.293s (2.293s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-nnt4m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-nnt4m

Started

Container started

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-56bcd69c95 from 0 to 1

opendatahub

llmisvc-controller-manager-6466c554d8-hsptq_539e6629-6296-4f53-ba3a-9bb376363616

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-hsptq_539e6629-6296-4f53-ba3a-9bb376363616 became leader

opendatahub

replicaset-controller

ai-gateway-controller-56bcd69c95

SuccessfulCreate

Created pod: ai-gateway-controller-56bcd69c95-g7ngq

opendatahub

kubelet

ai-gateway-controller-56bcd69c95-g7ngq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-56bcd69c95-g7ngq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 405ms (405ms including waiting). Image size: 183979430 bytes.

opendatahub

multus

ai-gateway-controller-56bcd69c95-g7ngq

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-56bcd69c95-g7ngq

Started

Container started

opendatahub

kubelet

ai-gateway-controller-56bcd69c95-g7ngq

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-7rzb7

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-5d8dddb676 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulDelete

Deleted pod: ai-gateway-controller-5d8dddb676-7rzb7

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-pd4sg

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-pd4sg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-pd4sg

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-r7qcl

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-pd4sg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.474s (1.474s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-pd4sg

Started

Container started

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-pd4sg

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-r7qcl

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-r7qcl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 316ms (316ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-r7qcl

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-r7qcl

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-r7qcl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-flgk9

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-flgk9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-flgk9

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.292s (1.292s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-flgk9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 286ms (286ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-c8zlh

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-flgk9

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-flgk9

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c8zlh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 294ms (294ms including waiting). Image size: 98346788 bytes.

llm

multus

echo-simulator-kserve-64b6f8f96c-c8zlh

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-xp98l

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xp98l

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 296ms (296ms including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-xp98l

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xp98l

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c8zlh

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c8zlh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.787s (1.787s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xp98l

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xp98l

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c8zlh

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 293ms (293ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

opendatahub

ai-gateway-controller-56bcd69c95-g7ngq_1667d126-a153-47e9-aa59-406c19cb0028

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-56bcd69c95-g7ngq_1667d126-a153-47e9-aa59-406c19cb0028 became leader

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-m6g9w

kuadrant-system

replicaset-controller

authorino-5fb64bd955

SuccessfulCreate

Created pod: authorino-5fb64bd955-5m6ww

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-65c448b547 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-vbrfc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-jv8f4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-jv8f4

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-m6g9w

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-vbrfc

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-m6g9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-m6g9w

Created

Container created

kuadrant-system

multus

authorino-5fb64bd955-5m6ww

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5fb64bd955-5m6ww

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-jv8f4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-jv8f4

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-m6g9w

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-jv8f4

Created

Container created

kuadrant-system

kubelet

authorino-5fb64bd955-5m6ww

Created

Container created

kuadrant-system

kubelet

authorino-5fb64bd955-5m6ww

Started

Container started

kuadrant-system

replicaset-controller

authorino-68d65c5784

SuccessfulDelete

Deleted pod: authorino-68d65c5784-6mkqh
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-68d65c5784 from 1 to 0

kuadrant-system

kubelet

authorino-5fb64bd955-5m6ww

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.068s (1.068s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-68d65c5784-6mkqh

Killing

Stopping container authorino

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.828s (2.828s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-jv8f4

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-jv8f4

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-m6g9w

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-m6g9w

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-65c448b547 from 4 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-b7gw6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-5lphd

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-5lphd

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b7gw6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-b7gw6

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b7gw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b7gw6

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b7gw6

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b7gw6

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-868a2ee9-openshift-default-65ddd584cc

SuccessfulCreate

Created pod: e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

openshift-ingress

gateway_labeler_controller

e2e-ait-868a2ee9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-868a2ee9

openshift-ingress

deployment-controller

e2e-ait-868a2ee9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-868a2ee9-openshift-default-65ddd584cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-ad831efe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ad831efe

openshift-ingress

replicaset-controller

e2e-ait-ad831efe-openshift-default-5c8ddf497f

SuccessfulCreate

Created pod: e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

openshift-ingress

deployment-controller

e2e-ait-ad831efe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ad831efe-openshift-default-5c8ddf497f from 0 to 1

openshift-ingress

multus

e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-38f4eea3-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-38f4eea3-gw

openshift-ingress

deployment-controller

e2e-migrate-38f4eea3-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc

SuccessfulCreate

Created pod: e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

openshift-ingress

multus

e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-0ae9c41e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0ae9c41e

openshift-ingress

deployment-controller

e2e-ait-0ae9c41e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0ae9c41e-openshift-default-6c6bfd575c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c

SuccessfulCreate

Created pod: e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

openshift-ingress

multus

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-38f4eea3-58557b46f5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-38f4eea3-58557b46f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-38f4eea3: serviceaccount "payload-processing-e2e-migrate-38f4eea3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-38f4eea3: serviceaccount "payload-processing-e2e-migrate-38f4eea3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-38f4eea3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-38f4eea3-959664bc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-38f4eea3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-38f4eea3-58557b46f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-38f4eea3-58557b46f5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ad831efe: serviceaccount "payload-processing-e2e-ait-ad831efe" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-868a2ee9-54664896ff-sndzv

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-868a2ee9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-868a2ee9-54664896ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-868a2ee9-54664896ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-868a2ee9-54664896ff-sndzv

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ad831efe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ad831efe-5fbb9fcdd9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-868a2ee9-54664896ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-868a2ee9-54664896ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-868a2ee9: serviceaccount "payload-processing-e2e-ait-868a2ee9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ad831efe-647887bb4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ad831efe-647887bb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ad831efe: serviceaccount "payload-processing-e2e-ait-ad831efe" not found

openshift-ingress

multus

payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ad831efe-647887bb4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p

openshift-ingress

kubelet

payload-processing-e2e-ait-868a2ee9-74bd97d5b7-s2x52

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm

openshift-ingress

multus

payload-processing-e2e-ait-868a2ee9-74bd97d5b7-s2x52

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-868a2ee9-74bd97d5b7-s2x52

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-868a2ee9-54664896ff-sndzv

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ait-868a2ee9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-868a2ee9-74bd97d5b7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-868a2ee9-54664896ff-sndzv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-868a2ee9-74bd97d5b7-s2x52

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ad831efe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ad831efe-647887bb4c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-868a2ee9-54664896ff-sndzv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-868a2ee9-74bd97d5b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-868a2ee9-74bd97d5b7-s2x52
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-868a2ee9-74bd97d5b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-868a2ee9-74bd97d5b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-868a2ee9: serviceaccount "payload-processing-e2e-ait-868a2ee9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0ae9c41e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0ae9c41e: serviceaccount "payload-processing-e2e-ait-0ae9c41e" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0ae9c41e: serviceaccount "payload-processing-e2e-ait-0ae9c41e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0ae9c41e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv

openshift-ingress

kubelet

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.785s (2.785s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 475ms (475ms including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.849s (2.849s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-derive-55f9886f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-55f9886f

openshift-ingress

replicaset-controller

e2e-derive-55f9886f-openshift-default-78956b55fc

SuccessfulCreate

Created pod: e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

openshift-ingress

deployment-controller

e2e-derive-55f9886f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-55f9886f-openshift-default-78956b55fc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.561s (1.561s including waiting). Image size: 125353963 bytes.

openshift-ingress

multus

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.286s (4.286s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.55s (4.55s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-derive-55f9886f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-55f9886f-5bd5b6fcd9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-55f9886f-76ff44474c-9k48k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-55f9886f-76ff44474c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-55f9886f-76ff44474c-9k48k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-55f9886f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-55f9886f-76ff44474c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-55f9886f-76ff44474c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-55f9886f-76ff44474c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-55f9886f: serviceaccount "payload-processing-e2e-derive-55f9886f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-55f9886f-76ff44474c-9k48k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-55f9886f-76ff44474c-9k48k

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-derive-55f9886f-76ff44474c-9k48k

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-55f9886f-5bd5b6fcd9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-c5gdq

openshift-ingress

multus

payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-c5gdq

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-c5gdq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-c5gdq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-c5gdq

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-55f9886f-5bd5b6fcd9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-55f9886f: serviceaccount "payload-processing-e2e-derive-55f9886f" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-38f4eea3-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-38f4eea3-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

Created

Container created

openshift-ingress

kubelet

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-55f9886f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-55f9886f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

Started

Container started

openshift-ingress

kubelet

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-38f4eea3-58557b46f5-hvlmq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-38f4eea3-959664bc9-lrqkb

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-868a2ee9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-868a2ee9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ad831efe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ad831efe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ae9c41e-676dd647bc-kglrv

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-0ae9c41e-5d6dbfc9b7-s69h9

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-38f4eea3-gw-openshift-default-7b4dc7dcc-xpcng

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0ae9c41e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w3-a37cf0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a37cf0-openshift-default-d9d86696c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-a37cf0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-a37cf0
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0ae9c41e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulCreate

Created pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

openshift-ingress

kubelet

payload-processing-e2e-ait-868a2ee9-74bd97d5b7-s2x52

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-868a2ee9-54664896ff-sndzv

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad831efe-647887bb4c-bk82p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ad831efe-5fbb9fcdd9-gwwrm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-868a2ee9-openshift-default-65ddd584cc-7xjhs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-55f9886f-76ff44474c-9k48k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-0ae9c41e-openshift-default-6c6bfd575c-bwc7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-55f9886f-5bd5b6fcd9-c5gdq

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-66eed1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-66eed1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-4b97c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-4b97c6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-a37cf0: serviceaccount "payload-processing-e2e-worker-w3-a37cf0" not found

openshift-ingress

kubelet

e2e-derive-55f9886f-openshift-default-78956b55fc-g5dk6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-a37cf0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-ad831efe-openshift-default-5c8ddf497f-pcz6k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-a37cf0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-a37cf0: serviceaccount "payload-processing-e2e-worker-w3-a37cf0" not found

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-77f103

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-77f103

openshift-ingress

multus

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-24cfb6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-24cfb6

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

Started

Container started

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-66eed1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-66eed1-68445545c7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-66eed1: serviceaccount "payload-processing-e2e-worker-w2-66eed1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-66eed1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-66eed1-68445545c7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-66eed1-68445545c7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-66eed1-68445545c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-66eed1: serviceaccount "payload-processing-e2e-worker-w2-66eed1" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4b97c6: serviceaccount "payload-processing-e2e-worker-w0-4b97c6" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-4b97c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4b97c6: serviceaccount "payload-processing-e2e-worker-w0-4b97c6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-4b97c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-4b97c6-74f55b5f69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-24cfb6-696bd96559

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-24cfb6-696bd96559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-24cfb6: serviceaccount "payload-processing-e2e-worker-w1-24cfb6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-24cfb6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-24cfb6-696bd96559 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-24cfb6-696bd96559

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-24cfb6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-24cfb6: serviceaccount "payload-processing-e2e-worker-w1-24cfb6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-77f103

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-77f103-5b4b55b64c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-77f103-5b4b55b64c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-77f103-5b4b55b64c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-77f103-5b4b55b64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-77f103: serviceaccount "payload-processing-e2e-worker-w4-77f103" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-77f103: serviceaccount "payload-processing-e2e-worker-w4-77f103" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-77f103

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": read tcp 10.134.0.2:55970->10.134.0.51:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": read tcp 10.134.0.2:55970->10.134.0.51:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulCreate

Created pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-a37cf0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a37cf0-openshift-default-d9d86696c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

Started

Container started

openshift-ingress

multus

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

Created

Container created

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

Created

Container created

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-695c8bf8d5

FailedCreate

Error creating: pods "payload-processing-external-model-695c8bf8d5-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-695c8bf8d5

SuccessfulCreate

Created pod: payload-processing-external-model-695c8bf8d5-lkd8j

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-695c8bf8d5 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-695c8bf8d5-lkd8j

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-695c8bf8d5-lkd8j

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-695c8bf8d5-lkd8j

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-695c8bf8d5-lkd8j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-a37cf0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a37cf0-openshift-default-d9d86696c from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulCreate

Created pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 2 to 3

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

Started

Container started

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-6f59d4c79f-g25tq

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6f59d4c79f-g25tq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-6f59d4c79f-g25tq

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-6f59d4c79f-g25tq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6f59d4c79f from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-6f59d4c79f

SuccessfulCreate

Created pod: payload-processing-external-model-6f59d4c79f-g25tq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

ProbeError

Readiness probe error: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

Unhealthy

Readiness probe failed: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-dtrzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-mdxxk

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-fl8ch

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-mdxxk

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-mdxxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-mdxxk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-65c448b547-dtrzt

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-mdxxk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xj2fs

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xj2fs

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-xj2fs

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xj2fs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-dtrzt

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-dtrzt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-dtrzt

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-fl8ch

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-fl8ch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-fl8ch

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-xj2fs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-fl8ch

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-695c8bf8d5

SuccessfulDelete

Deleted pod: payload-processing-external-model-695c8bf8d5-lkd8j

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-695c8bf8d5 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-695c8bf8d5-lkd8j

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-bb6976b77

SuccessfulCreate

Created pod: payload-processing-external-model-bb6976b77-7rk7g
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-bb6976b77-7rk7g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-bb6976b77-7rk7g

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-bb6976b77-7rk7g

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-bb6976b77-7rk7g

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-fl8ch

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-mdxxk

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-mdxxk

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-dtrzt

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-dtrzt

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-fl8ch

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xj2fs

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xj2fs

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-6f59d4c79f-g25tq

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6f59d4c79f from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-6f59d4c79f

SuccessfulDelete

Deleted pod: payload-processing-external-model-6f59d4c79f-g25tq

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Unhealthy

Readiness probe failed: Get "https://10.132.0.49:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 3 to 5

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

Started

Container started

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

Created

Container created

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6699fcb7fd-jl6qr

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6699fcb7fd-jl6qr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-6699fcb7fd

SuccessfulCreate

Created pod: payload-processing-external-model-6699fcb7fd-jl6qr

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6699fcb7fd from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-6699fcb7fd-jl6qr

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6699fcb7fd-jl6qr

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 3 to 6

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-bb6976b77 from 1 to 0

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-bb6976b77-7rk7g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-bb6976b77

SuccessfulDelete

Deleted pod: payload-processing-external-model-bb6976b77-7rk7g

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-bktgf
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-bktgf

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 5 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bktgf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 6 to 8

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

Started

Container started

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

Created

Container created

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bktgf

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bktgf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.227s (3.227s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bktgf

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bktgf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bktgf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

Created

Container created

openshift-ingress

multus

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

Started

Container started

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-bb6976b77-pkvhn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-bb6976b77 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-bb6976b77-pkvhn

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-bb6976b77

SuccessfulCreate

Created pod: payload-processing-external-model-bb6976b77-pkvhn

models-as-a-service

kubelet

payload-processing-external-model-bb6976b77-pkvhn

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-bb6976b77-pkvhn

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6699fcb7fd-jl6qr

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-bb6976b77-pkvhn

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 8 to 10

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

Started

Container started

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

ProbeError

Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

Unhealthy

Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b7gw6

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b7gw6

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

Started

Container started

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-a-2893d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2893d1-openshift-default-546f79d79 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-2893d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2893d1

openshift-ingress

replicaset-controller

e2e-api-a-2893d1-openshift-default-546f79d79

SuccessfulCreate

Created pod: e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

openshift-ingress

multus

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-m6g9w

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-h95t4

Unhealthy

Liveness probe failed: Get "http://10.134.0.25:6080/livez": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-m6g9w

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-h95t4

Unhealthy

Readiness probe failed: Get "http://10.134.0.25:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-mt-da5f07e6-openshift-default-577cff9d8f

SuccessfulCreate

Created pod: e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

openshift-ingress

gateway_labeler_controller

e2e-mt-da5f07e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-da5f07e6

openshift-ingress

deployment-controller

e2e-mt-da5f07e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-da5f07e6-openshift-default-577cff9d8f from 0 to 1

openshift-ingress

multus

e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2893d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2893d1-6f96d89487 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2893d1-6f96d89487

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2893d1-6f96d89487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2893d1: serviceaccount "payload-processing-e2e-api-a-2893d1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2893d1-65f66fb94f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2893d1-65f66fb94f-mfpb2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2893d1-65f66fb94f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2893d1-65f66fb94f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2893d1: serviceaccount "payload-processing-e2e-api-a-2893d1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2893d1-6f96d89487

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2893d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2893d1-65f66fb94f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-2893d1-65f66fb94f-mfpb2

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-2893d1-65f66fb94f-mfpb2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2893d1-65f66fb94f-mfpb2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-2893d1-65f66fb94f-mfpb2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-da5f07e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-da5f07e6-6f55cbb87f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-da5f07e6-6f55cbb87f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-da5f07e6: serviceaccount "payload-processing-e2e-mt-da5f07e6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-da5f07e6-6f55cbb87f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-mt-da5f07e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-da5f07e6-6f55cbb87f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-da5f07e6: serviceaccount "payload-processing-e2e-mt-da5f07e6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-a-58970f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-58970f

openshift-ingress

deployment-controller

e2e-api-a-58970f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-58970f-openshift-default-bd89b5d7f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-58970f-openshift-default-bd89b5d7f

SuccessfulCreate

Created pod: e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

openshift-ingress

multus

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 4 to 8

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

Created

Container created

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-58970f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-58970f-5d9f55f84f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-58970f-5d9f55f84f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-58970f-5d9f55f84f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-58970f: serviceaccount "payload-processing-e2e-api-a-58970f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-58970f-76bf8f9875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-58970f-76bf8f9875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-58970f: serviceaccount "payload-processing-e2e-api-a-58970f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-58970f-76bf8f9875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-58970f-76bf8f9875-lfqpt

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-58970f-5d9f55f84f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-58970f-5d9f55f84f-vxdmd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-58970f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-58970f-76bf8f9875 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-58970f-5d9f55f84f-vxdmd

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-58970f-76bf8f9875-lfqpt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2893d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2893d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-58970f-5d9f55f84f-vxdmd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-58970f-5d9f55f84f-vxdmd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-58970f-76bf8f9875-lfqpt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-58970f-5d9f55f84f-vxdmd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-58970f-76bf8f9875-lfqpt

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-58970f-76bf8f9875-lfqpt

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-935086

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-935086

openshift-ingress

replicaset-controller

e2e-api-b-935086-openshift-default-8497785c69

SuccessfulCreate

Created pod: e2e-api-b-935086-openshift-default-8497785c69-j2mzw

openshift-ingress

deployment-controller

e2e-api-b-935086-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-935086-openshift-default-8497785c69 from 0 to 1

openshift-ingress

multus

e2e-api-b-935086-openshift-default-8497785c69-j2mzw

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

ProbeError

Startup probe error: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulCreate

Created pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulCreate

Created pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

openshift-ingress

deployment-controller

e2e-worker-w3-a37cf0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a37cf0-openshift-default-d9d86696c from 3 to 6
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

Unhealthy

Startup probe failed: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulCreate

Created pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

Created

Container created

openshift-ingress

multus

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

Started

Container started

openshift-ingress

multus

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

Created

Container created

openshift-ingress

multus

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-935086-557dbc4555-g9w9n

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-935086

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-935086-557dbc4555 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-935086-79d69586ff

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-935086-79d69586ff-9lls5

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-935086

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-935086-79d69586ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-935086-79d69586ff

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-935086-79d69586ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-935086: serviceaccount "payload-processing-e2e-api-b-935086" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-935086-557dbc4555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-935086-557dbc4555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-935086: serviceaccount "payload-processing-e2e-api-b-935086" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-935086-557dbc4555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-935086-557dbc4555-g9w9n

openshift-ingress

multus

payload-processing-e2e-api-b-935086-79d69586ff-9lls5

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-935086-557dbc4555-g9w9n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-935086-557dbc4555-g9w9n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-935086-79d69586ff-9lls5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-935086-557dbc4555-g9w9n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-935086-79d69586ff-9lls5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-935086-79d69586ff-9lls5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-2129b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2129b9

openshift-ingress

deployment-controller

e2e-api-b-2129b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2129b9-openshift-default-6d96dc7649 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-2129b9-openshift-default-6d96dc7649

SuccessfulCreate

Created pod: e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

ProbeError

Startup probe error: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-dl596

openshift-ingress

kubelet

e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8

Started

Container started

openshift-ingress

kubelet

e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

Unhealthy

Startup probe failed: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3
(x8)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dl596

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x2)

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

Started

Container started

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-dl596

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2129b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2129b9-7485dc875f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2129b9-7485dc875f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2129b9-7485dc875f-qhrcb
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da5f07e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2129b9-7485dc875f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2129b9-7485dc875f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2129b9: serviceaccount "payload-processing-e2e-api-b-2129b9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2129b9-f569b5cc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-86jp4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da5f07e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2129b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2129b9-f569b5cc5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2129b9-f569b5cc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2129b9: serviceaccount "payload-processing-e2e-api-b-2129b9" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-2129b9-7485dc875f-qhrcb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-2129b9-7485dc875f-qhrcb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-2129b9-7485dc875f-qhrcb

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dl596

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-86jp4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-86jp4

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-86jp4

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-2129b9-7485dc875f-qhrcb

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dl596

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.185s (4.185s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-86jp4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dl596

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dl596

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dl596

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-a976bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a976bc

openshift-ingress

replicaset-controller

e2e-api-a-a976bc-openshift-default-666f9d9749

SuccessfulCreate

Created pod: e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

openshift-ingress

deployment-controller

e2e-api-a-a976bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a976bc-openshift-default-666f9d9749 from 0 to 1

openshift-ingress

multus

e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

Started

Container started

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a976bc-fc44d487f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a976bc-fc44d487f-r8c2h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a976bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a976bc-fc44d487f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a976bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a976bc-7b74756c79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a976bc-7b74756c79

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a976bc-7b74756c79-mjx4z
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a976bc-7b74756c79

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a976bc-7b74756c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a976bc: serviceaccount "payload-processing-e2e-api-a-a976bc" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a976bc-fc44d487f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a976bc-fc44d487f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a976bc: serviceaccount "payload-processing-e2e-api-a-a976bc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a976bc-fc44d487f-r8c2h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-a976bc-7b74756c79-mjx4z

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a976bc-fc44d487f-r8c2h

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a976bc-fc44d487f-r8c2h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a976bc-fc44d487f-r8c2h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-a976bc-7b74756c79-mjx4z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-a976bc-7b74756c79-mjx4z

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-a976bc-7b74756c79-mjx4z

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2893d1-65f66fb94f-mfpb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-58970f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-58970f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

ProbeError

Readiness probe error: Get "http://10.132.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

Unhealthy

Readiness probe failed: Get "http://10.132.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-935086-openshift-default-8497785c69-j2mzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-935086-openshift-default-8497785c69-j2mzw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-935086-openshift-default-8497785c69-j2mzw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2893d1-6f96d89487-h4hg9

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.83:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2893d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2893d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-935086-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-935086-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2129b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2129b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-935086-openshift-default-8497785c69-j2mzw

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-935086-openshift-default-8497785c69-j2mzw

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-58970f-5d9f55f84f-vxdmd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-58970f-76bf8f9875-lfqpt

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da5f07e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da5f07e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-58970f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-58970f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-58970f-openshift-default-bd89b5d7f-gk4zp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-2893d1-openshift-default-546f79d79-hxgpf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a976bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-b-11f0a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-11f0a3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a976bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-11f0a3-openshift-default-74d55d7b87

SuccessfulCreate

Created pod: e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

openshift-ingress

deployment-controller

e2e-api-b-11f0a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-11f0a3-openshift-default-74d55d7b87 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-935086-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-935086-79d69586ff-9lls5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-935086-557dbc4555-g9w9n

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-935086-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2129b9-f569b5cc5-86jp4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2129b9-7485dc875f-qhrcb

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-11f0a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-11f0a3-956d967fc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-11f0a3-956d967fc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-11f0a3-956d967fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-11f0a3: serviceaccount "payload-processing-e2e-api-b-11f0a3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-11f0a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-11f0a3-c967574b7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-11f0a3-c967574b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-11f0a3-c967574b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-11f0a3: serviceaccount "payload-processing-e2e-api-b-11f0a3" not found

openshift-ingress

multus

payload-processing-e2e-api-b-11f0a3-956d967fc-5jjsj

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-11f0a3-956d967fc-5jjsj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-11f0a3-956d967fc-5jjsj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-11f0a3-c967574b7-s95gk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-11f0a3-956d967fc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-11f0a3-956d967fc-5jjsj

openshift-ingress

kubelet

payload-processing-e2e-api-b-11f0a3-956d967fc-5jjsj

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-11f0a3-c967574b7-s95gk

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-11f0a3-c967574b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-11f0a3-c967574b7-s95gk

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-11f0a3-c967574b7-s95gk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-11f0a3-c967574b7-s95gk

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-da5f07e6-openshift-default-577cff9d8f

SuccessfulCreate

Created pod: e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da5f07e6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-da5f07e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-da5f07e6-openshift-default-577cff9d8f from 1 to 2

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

Created

Container created

openshift-ingress

multus

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

Started

Container started

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-935086-openshift-default-8497785c69-j2mzw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8

ProbeError

Readiness probe error: Get "http://10.132.0.120:15021/healthz/ready": read tcp 10.132.0.2:48854->10.132.0.120:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-b-2129b9-openshift-default-6d96dc7649-2gxc8

Unhealthy

Readiness probe failed: Get "http://10.132.0.120:15021/healthz/ready": read tcp 10.132.0.2:48854->10.132.0.120:15021: read: connection reset by peer

opendatahub

multus

test-curl-7347-a5f1c6

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7347-a5f1c6

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7347-a5f1c6

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.001s (2.001s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7347-a5f1c6

Started

Container started

opendatahub

kubelet

test-curl-7347-a5f1c6

Created

Container created

opendatahub

kubelet

test-curl-7347-a5f1c6

Killing

Stopping container test-curl-7347-a5f1c6

openshift-ingress

kubelet

payload-processing-e2e-api-a-a976bc-7b74756c79-mjx4z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a976bc-fc44d487f-r8c2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-4c9298

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-4c9298

openshift-ingress

deployment-controller

e2e-ipp-a-4c9298-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-4c9298-openshift-default-6bb79c769 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-4c9298-openshift-default-6bb79c769

SuccessfulCreate

Created pod: e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

openshift-ingress

multus

e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-a976bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a976bc-openshift-default-666f9d9749 from 1 to 4

openshift-ingress

replicaset-controller

e2e-api-a-a976bc-openshift-default-666f9d9749

SuccessfulCreate

Created pod: e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d1fc77

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d1fc77

openshift-ingress

replicaset-controller

e2e-api-a-a976bc-openshift-default-666f9d9749

SuccessfulCreate

Created pod: e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

openshift-ingress

replicaset-controller

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c

SuccessfulCreate

Created pod: e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

openshift-ingress

deployment-controller

e2e-ipp-a-d1fc77-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a976bc-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-a976bc-openshift-default-666f9d9749

SuccessfulCreate

Created pod: e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

openshift-ingress

multus

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

Started

Container started

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

Created

Container created

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

Started

Container started

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

Created

Container created

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

Started

Container started

openshift-ingress

multus

e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

Created

Container created
(x3)

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

ProbeError

Readiness probe error: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

Unhealthy

Readiness probe failed: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-g7mdd

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

Unhealthy

Readiness probe failed: Get "http://10.132.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

ProbeError

Readiness probe error: Get "http://10.132.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-njg64

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-4hdhw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4c9298-86597cb9bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4c9298-86597cb9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4c9298: serviceaccount "payload-processing-e2e-ipp-a-4c9298" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4c9298: serviceaccount "payload-processing-e2e-ipp-a-4c9298" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4c9298

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-4hdhw

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-j2cvp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-a976bc-openshift-default-666f9d9749-rv6p2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4c9298

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4c9298-86597cb9bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4c9298-86597cb9bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4c9298-86597cb9bc-jrw44

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-jhrnp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d1fc77-55f986b45

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d1fc77-55f986b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d1fc77: serviceaccount "payload-processing-e2e-ipp-a-d1fc77" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-4hdhw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-86597cb9bc-jrw44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d1fc77: serviceaccount "payload-processing-e2e-ipp-a-d1fc77" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-4hdhw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-4hdhw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-4c9298-86597cb9bc-jrw44

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d1fc77

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d1fc77-55f986b45 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d1fc77

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d1fc77-55f986b45

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d1fc77-55f986b45-fp7zr

openshift-ingress

multus

payload-processing-e2e-ipp-a-d1fc77-55f986b45-fp7zr

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-55f986b45-fp7zr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-jhrnp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-86597cb9bc-jrw44

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-jhrnp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-86597cb9bc-jrw44

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-jhrnp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-jhrnp

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-55f986b45-fp7zr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-55f986b45-fp7zr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-11f0a3-c967574b7-s95gk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-11f0a3-956d967fc-5jjsj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-gp7kp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-rzl8j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-11f0a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-11f0a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

Unhealthy

Startup probe failed: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

ProbeError

Startup probe error: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-11f0a3-openshift-default-74d55d7b87-zpplg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-82b305-openshift-default-7bb775b8c5

SuccessfulCreate

Created pod: e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

openshift-ingress

deployment-controller

e2e-ipp-a-82b305-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-82b305-openshift-default-7bb775b8c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-82b305

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-82b305

openshift-ingress

multus

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-ptm88
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-da5f07e6: serviceaccount "payload-processing-e2e-mt-da5f07e6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-da5f07e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-da5f07e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-da5f07e6-6f55cbb87f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-da5f07e6-6f55cbb87f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-da5f07e6-6f55cbb87f-wwqcg
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-da5f07e6-6f55cbb87f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-da5f07e6-6f55cbb87f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-da5f07e6: serviceaccount "payload-processing-e2e-mt-da5f07e6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-ptm88

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-wwqcg

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-wwqcg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-ptm88

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-wwqcg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-wwqcg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-ptm88

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-ptm88

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-82b305

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-82b305-799459bc57 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-82b305-799459bc57

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-82b305-799459bc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-82b305: serviceaccount "payload-processing-e2e-ipp-a-82b305" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-82b305-799459bc57

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-82b305-799459bc57-lsd7h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-82b305-779c546bdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-82b305: serviceaccount "payload-processing-e2e-ipp-a-82b305" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-82b305-779c546bdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-655nq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-82b305

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-82b305-779c546bdc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-655nq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-655nq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-655nq

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-86597cb9bc-jrw44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-655nq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-6579fd96d7-4hdhw

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-82b305-799459bc57-lsd7h

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-799459bc57-lsd7h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-799459bc57-lsd7h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-799459bc57-lsd7h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7987b86bb7-jhrnp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-55f986b45-fp7zr

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4c9298-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4c9298-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d1fc77-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d1fc77-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4c9298: serviceaccount "payload-processing-e2e-ipp-a-4c9298" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4c9298

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4c9298-f5bc5b98d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4c9298: serviceaccount "payload-processing-e2e-ipp-a-4c9298" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4c9298

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d1fc77

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d1fc77-96dbb44c8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d1fc77

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d1fc77: serviceaccount "payload-processing-e2e-ipp-a-d1fc77" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d1fc77: serviceaccount "payload-processing-e2e-ipp-a-d1fc77" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.329s (4.329s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.423s (2.423s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.206s (4.206s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.726s (2.726s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-82b305-779c546bdc-655nq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-799459bc57-lsd7h

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

Created

Container created

opendatahub

multus

test-curl-7347-e38d82

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

Started

Container started

opendatahub

kubelet

test-curl-7347-e38d82

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

Started

Container started

opendatahub

kubelet

test-curl-7347-e38d82

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7347-e38d82

Started

Container started

opendatahub

kubelet

test-curl-7347-e38d82

Killing

Stopping container test-curl-7347-e38d82
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-82b305-6664b9c9c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-82b305-6664b9c9c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-82b305: serviceaccount "payload-processing-e2e-ipp-a-82b305" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-82b305: serviceaccount "payload-processing-e2e-ipp-a-82b305" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-82b305

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-82b305-6664b9c9c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-ngg2f

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-82b305-6664b9c9c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-82b305

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-ngg2f

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-ngg2f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-ngg2f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-ngg2f

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.017s (2.017s including waiting). Image size: 166620835 bytes.
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8f7957

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8f7957

openshift-ingress

kubelet

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

ProbeError

Readiness probe error: Get "http://10.132.0.131:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

Unhealthy

Readiness probe failed: Get "http://10.132.0.131:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-dd1cba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-dd1cba

openshift-ingress

multus

e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-8f7957-openshift-default-8dc7996fc

SuccessfulCreate

Created pod: e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

openshift-ingress

deployment-controller

e2e-ipp-b-8f7957-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8f7957-openshift-default-8dc7996fc from 0 to 1

openshift-ingress

deployment-controller

e2e-ipp-b-dd1cba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-dd1cba-openshift-default-6788f4f759 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-dd1cba-openshift-default-6788f4f759

SuccessfulCreate

Created pod: e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

openshift-ingress

multus

e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8f7957

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8f7957-6f59c86459 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8f7957

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-jzvcm

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dd1cba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-jzvcm

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-jzvcm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-jzvcm

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8f7957: serviceaccount "payload-processing-e2e-ipp-b-8f7957" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-jzvcm

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8f7957-6f59c86459

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8f7957-6f59c86459-q6xln
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8f7957-6f59c86459

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8f7957-6f59c86459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8f7957: serviceaccount "payload-processing-e2e-ipp-b-8f7957" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f7957-6f59c86459-q6xln

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dd1cba: serviceaccount "payload-processing-e2e-ipp-b-dd1cba" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dd1cba: serviceaccount "payload-processing-e2e-ipp-b-dd1cba" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f7957-6f59c86459-q6xln

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f7957-6f59c86459-q6xln

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-8f7957-6f59c86459-q6xln

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-t4wpz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dd1cba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-gqxkc

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-t4wpz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-t4wpz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-gqxkc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-t4wpz

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-gqxkc

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-t4wpz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-gqxkc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-gqxkc

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7

SuccessfulCreate

Created pod: e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c8832b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c8832b

openshift-ingress

deployment-controller

e2e-ipp-b-c8832b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c8832b-openshift-default-f9d6b68f7 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4c9298-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4c9298-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d1fc77-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d1fc77-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-rkb6z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c8832b: serviceaccount "payload-processing-e2e-ipp-b-c8832b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c8832b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c8832b-68d9664bd7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c8832b-68d9664bd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c8832b: serviceaccount "payload-processing-e2e-ipp-b-c8832b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c8832b-68d9664bd7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c8832b-68d9664bd7-sw6ff

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c8832b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c8832b-68d9664bd7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-c8832b-68d9664bd7-sw6ff

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-68d9664bd7-sw6ff

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-rkb6z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-rkb6z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-68d9664bd7-sw6ff

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-rkb6z

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-rkb6z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-68d9664bd7-sw6ff

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f7957-6f59c86459-q6xln

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-b-8f7957

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-b-8f7957: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-b-8f7957": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-b-8f7957, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 52098093-3233-4d34-a923-eaf5dcd30cf9, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dd1cba-847946cbdc-gqxkc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dd1cba-7c57d9bd65-t4wpz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f7957-7d69c77b67-jzvcm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-da5f07e6-6f55cbb87f-wwqcg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da5f07e6-6f5c8bcf8c-ptm88

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8f7957

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8f7957-74f686f95b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8f7957: serviceaccount "payload-processing-e2e-ipp-b-8f7957" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8f7957

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8f7957-74f686f95b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8f7957-74f686f95b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8f7957: serviceaccount "payload-processing-e2e-ipp-b-8f7957" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-whkb5

openshift-ingress

multus

payload-processing-e2e-ipp-b-8f7957-74f686f95b-jnvkj

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8f7957-74f686f95b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8f7957-74f686f95b-jnvkj

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f7957-74f686f95b-jnvkj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f7957-74f686f95b-jnvkj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f7957-74f686f95b-jnvkj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dd1cba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dd1cba-d6755c6c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-whkb5

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dd1cba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dd1cba-766db84587 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-whkb5

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dd1cba-d6755c6c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dd1cba: serviceaccount "payload-processing-e2e-ipp-b-dd1cba" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-whkb5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-whkb5

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dd1cba-d6755c6c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-7rbsd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dd1cba-766db84587

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-xk66b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dd1cba-766db84587

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dd1cba: serviceaccount "payload-processing-e2e-ipp-b-dd1cba" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-7rbsd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-xk66b

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-xk66b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-xk66b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-7rbsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-xk66b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-7rbsd

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-7rbsd

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-82b305-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-82b305-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dd1cba-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dd1cba-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-68d9664bd7-sw6ff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c8832b-5c5f6c56c5-rkb6z

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-mtnhn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-cd2738

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-cd2738

openshift-ingress

replicaset-controller

e2e-api-a-cd2738-openshift-default-6fcb5885b7

SuccessfulCreate

Created pod: e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

openshift-ingress

deployment-controller

e2e-api-a-cd2738-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-cd2738-openshift-default-6fcb5885b7 from 0 to 1

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-da5f07e6-openshift-default-577cff9d8f-q8r8c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c8832b-64f867f664

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c8832b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c8832b-64f867f664 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-htzj4

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c8832b-64f867f664

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c8832b-64f867f664-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c8832b: serviceaccount "payload-processing-e2e-ipp-b-c8832b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c8832b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-htzj4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c8832b: serviceaccount "payload-processing-e2e-ipp-b-c8832b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-htzj4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-bw2fg

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-cd2738

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-cd2738-6789f47f85 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-htzj4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cd2738-6789f47f85

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-cd2738-6789f47f85-7dvjc

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-htzj4

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-cd2738

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cd2738-6789f47f85

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-cd2738-6789f47f85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cd2738: serviceaccount "payload-processing-e2e-api-a-cd2738" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cd2738: serviceaccount "payload-processing-e2e-api-a-cd2738" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-bw2fg

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-cd2738-6789f47f85-7dvjc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-bw2fg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-bw2fg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-cd2738-6789f47f85-7dvjc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-cd2738-6789f47f85-7dvjc

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-bw2fg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-cd2738-6789f47f85-7dvjc

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8f7957-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8f7957-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dd1cba-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dd1cba-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c8832b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c8832b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d1fc77-96dbb44c8-sfzqv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d1fc77-7dc6cdbdc-wzztb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-d1fc77

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-d1fc77: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-d1fc77": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-d1fc77, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 75bf7206-8475-458f-b1dc-6bed0d018bde, UID in object meta:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8f7957-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8f7957-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c8832b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c8832b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-a-82b305

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-a-82b305: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-a-82b305": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-a-82b305, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e0a1bfce-5741-46ec-90a5-676c7b49abfd, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-82b305-7c58b8cf9f-ngg2f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-d1fc77-openshift-default-5d7d996b8c-rqwtx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-3568c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3568c5-openshift-default-5c5b74796c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-3568c5-openshift-default-5c5b74796c

SuccessfulCreate

Created pod: e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-82b305-6664b9c9c8-5tzqf

Unhealthy

Readiness probe failed: dial tcp 10.133.0.118:9004: i/o timeout

openshift-ingress

gateway_labeler_controller

e2e-api-b-3568c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3568c5

openshift-ingress

multus

e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3568c5-799fc4fc99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3568c5: serviceaccount "payload-processing-e2e-api-b-3568c5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3568c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3568c5-5468488957 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3568c5-5468488957

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3568c5-5468488957-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3568c5: serviceaccount "payload-processing-e2e-api-b-3568c5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3568c5-5468488957

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3568c5-5468488957-njxbf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3568c5-799fc4fc99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-bzq6q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3568c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3568c5-799fc4fc99 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-bzq6q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-bzq6q

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-3568c5-5468488957-njxbf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-3568c5-5468488957-njxbf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-bzq6q

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-3568c5-5468488957-njxbf

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-bzq6q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-3568c5-5468488957-njxbf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-82b305-openshift-default-7bb775b8c5-b6rth

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-b-dd1cba

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-b-dd1cba: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-b-dd1cba": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-b-dd1cba, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 47ac2011-3859-4f36-b39d-ff8bffd161e0, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dd1cba-d6755c6c4-7rbsd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dd1cba-766db84587-xk66b

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cd2738-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cd2738-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c8832b-64fbbb4fd7-htzj4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c8832b-64f867f664-zmlgl

Unhealthy

Readiness probe failed: dial tcp 10.133.0.128:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-dd1cba-openshift-default-6788f4f759-5x5vk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-e4fdc1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-e4fdc1

openshift-ingress

replicaset-controller

e2e-praxis-a-e4fdc1-openshift-default-8476767889

SuccessfulCreate

Created pod: e2e-praxis-a-e4fdc1-openshift-default-8476767889-d9fkh

openshift-ingress

deployment-controller

e2e-praxis-a-e4fdc1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e4fdc1-openshift-default-8476767889 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-e4fdc1-openshift-default-8476767889-d9fkh

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-e4fdc1-openshift-default-8476767889-d9fkh

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-e4fdc1-openshift-default-8476767889-d9fkh

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-e4fdc1-openshift-default-8476767889-d9fkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

ProbeError

Startup probe error: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

Unhealthy

Startup probe failed: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c

SuccessfulCreate

Created pod: e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

openshift-ingress

kubelet

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6098d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6098d0

openshift-ingress

deployment-controller

e2e-ipp-a-6098d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6098d0-openshift-default-5ccb49c75c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-e4fdc1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-7dbdb8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-7dbdb8

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-gqzb6

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-e4fdc1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e4fdc1: serviceaccount "payload-processing-e2e-praxis-a-e4fdc1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-8fd6h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e4fdc1: serviceaccount "payload-processing-e2e-praxis-a-e4fdc1" not found

openshift-ingress

multus

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-8fd6h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-8fd6h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-8fd6h

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f

SuccessfulCreate

Created pod: e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-gqzb6

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-8fd6h

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-7dbdb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-7dbdb8-openshift-default-7bb994464f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-gqzb6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-gqzb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-gqzb6

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-c8832b-openshift-default-f9d6b68f7-v85mp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6098d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6098d0: serviceaccount "payload-processing-e2e-ipp-a-6098d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6098d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-dgh9n

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-cvn56
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6098d0: serviceaccount "payload-processing-e2e-ipp-a-6098d0" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-dgh9n

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-cvn56

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-cvn56

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-cvn56

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-dgh9n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-dgh9n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-dgh9n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-cvn56

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-7dbdb8-586545b55c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-7dbdb8-586545b55c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-7dbdb8: serviceaccount "payload-processing-e2e-praxis-a-7dbdb8" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-7dbdb8: serviceaccount "payload-processing-e2e-praxis-a-7dbdb8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-x4hzs

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-7dbdb8-586545b55c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-7dbdb8-586545b55c-b9l8w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-7dbdb8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-7dbdb8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-7dbdb8-586545b55c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7dbdb8-586545b55c-b9l8w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7dbdb8-586545b55c-b9l8w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-7dbdb8-586545b55c-b9l8w

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-x4hzs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7dbdb8-586545b55c-b9l8w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-x4hzs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-x4hzs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-x4hzs

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e4fdc1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e4fdc1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-48qf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-4jwl5

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-slice-controller

payload-processing-e2e-api-a-cd2738

FailedToUpdateEndpointSlices

Error updating Endpoint Slices for Service openshift-ingress/payload-processing-e2e-api-a-cd2738: failed to update payload-processing-e2e-api-a-cd2738-frhdx EndpointSlice for Service openshift-ingress/payload-processing-e2e-api-a-cd2738: endpointslices.discovery.k8s.io "payload-processing-e2e-api-a-cd2738-frhdx" not found

openshift-ingress

endpoint-controller

payload-processing-e2e-api-a-cd2738

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-api-a-cd2738: Operation cannot be fulfilled on endpoints "payload-processing-e2e-api-a-cd2738": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-api-a-cd2738, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dc16ca00-855e-499c-aa9d-bfeb6eb3a108, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-cd2738-6789f47f85-7dvjc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cd2738-6c7bcfd6c5-bw2fg

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cd2738-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cd2738-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e4fdc1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e4fdc1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-b-009a5f-openshift-default-c547f59b5

SuccessfulCreate

Created pod: e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

openshift-ingress

deployment-controller

e2e-praxis-b-009a5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-009a5f-openshift-default-c547f59b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-009a5f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-009a5f

openshift-ingress

multus

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6098d0-57f8b4f46c-cvn56

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6098d0-6b6bb6fb87-dgh9n

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-009a5f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-bd7wg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-009a5f-5cbdb6898c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-009a5f: serviceaccount "payload-processing-e2e-praxis-b-009a5f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-009a5f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-009a5f-5cbdb6898c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-009a5f: serviceaccount "payload-processing-e2e-praxis-b-009a5f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-009a5f-5cbdb6898c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-2h44b

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-4a5f09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-4a5f09

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4c9298-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-2h44b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-2h44b

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-bd7wg

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-2h44b

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-bd7wg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-bd7wg

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-4c9298-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-4c9298-openshift-default-6bb79c769 from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-2h44b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-bd7wg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-4c9298-openshift-default-6bb79c769

SuccessfulCreate

Created pod: e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

openshift-ingress

multus

e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-cd2738-openshift-default-6fcb5885b7-7qclq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-4a5f09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-4a5f09-openshift-default-854695dbf7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-4a5f09-openshift-default-854695dbf7

SuccessfulCreate

Created pod: e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3568c5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3568c5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-4a5f09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4a5f09: serviceaccount "payload-processing-e2e-praxis-b-4a5f09" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-vxtkm

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-4a5f09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-nnsw5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4a5f09: serviceaccount "payload-processing-e2e-praxis-b-4a5f09" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-nnsw5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3568c5-799fc4fc99-bzq6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-nnsw5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6098d0-8579456655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6098d0-8579456655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6098d0: serviceaccount "payload-processing-e2e-ipp-a-6098d0" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-3568c5-5468488957-njxbf

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6098d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6098d0-8579456655 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-nnsw5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-vxtkm

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-nnsw5

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6098d0-54bf87cbc6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6098d0: serviceaccount "payload-processing-e2e-ipp-a-6098d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6098d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6098d0-54bf87cbc6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-vxtkm

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

ProbeError

Startup probe error: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-vxtkm

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

Unhealthy

Startup probe failed: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-vxtkm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6098d0-54bf87cbc6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-snhcx

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6098d0-8579456655-vt6dq

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6098d0-8579456655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6098d0-8579456655-vt6dq

openshift-ingress

multus

payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-snhcx

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6098d0-8579456655-vt6dq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-x2lvh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6098d0-8579456655-vt6dq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6098d0-8579456655-vt6dq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-snhcx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-snhcx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-snhcx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-szstg

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-7pdvz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-fxnft

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4a5f09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4a5f09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3568c5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3568c5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w3-a37cf0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a37cf0-openshift-default-d9d86696c from 6 to 5

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

Unhealthy

Readiness probe failed: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulDelete

Deleted pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-lg9ks

openshift-ingress

kubelet

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

ProbeError

Readiness probe error: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-eda8e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-eda8e2

openshift-ingress

replicaset-controller

e2e-ipp-b-eda8e2-openshift-default-c8f649447

SuccessfulCreate

Created pod: e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

openshift-ingress

deployment-controller

e2e-ipp-b-eda8e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-eda8e2-openshift-default-c8f649447 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6098d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6098d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-3568c5-openshift-default-5c5b74796c-nwgw9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eda8e2-9dc6895df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eda8e2-9dc6895df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eda8e2: serviceaccount "payload-processing-e2e-ipp-b-eda8e2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eda8e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eda8e2-9dc6895df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eda8e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7dbdb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7dbdb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c

SuccessfulCreate

Created pod: e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

openshift-ingress

deployment-controller

e2e-praxis-a-d8e217-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d8e217-openshift-default-7d8b8df87c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d8e217

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d8e217

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eda8e2-9dc6895df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eda8e2-9dc6895df-hfl69
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eda8e2: serviceaccount "payload-processing-e2e-ipp-b-eda8e2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-c8qcb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-c8qcb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-c8qcb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eda8e2-9dc6895df-hfl69

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eda8e2-9dc6895df-hfl69

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eda8e2-9dc6895df-hfl69

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-eda8e2-9dc6895df-hfl69

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-c8qcb

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-c8qcb

Created

Container created

openshift-ingress

multus

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d8e217

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d8e217: serviceaccount "payload-processing-e2e-praxis-a-d8e217" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d8e217

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d8e217: serviceaccount "payload-processing-e2e-praxis-a-d8e217" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e4fdc1-67ccbbd9c7-gqzb6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e4fdc1-5f4588b47f-8fd6h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-qsfpl

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-25xtn
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6098d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6098d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7dbdb8-7b497bf779-x4hzs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7dbdb8-586545b55c-b9l8w

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

ProbeError

Startup probe error: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

Unhealthy

Startup probe failed: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7dbdb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7dbdb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4c9298-5bb5947cf9-rllcn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4c9298-f5bc5b98d-spsf5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-e4fdc1-openshift-default-8476767889-d9fkh

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-009a5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-009a5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-7dbdb8-openshift-default-7bb994464f-mhrv8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-qzf9k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-4c9298-openshift-default-6bb79c769-rdqlz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eda8e2-6764675cc5-c8qcb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eda8e2-9dc6895df-hfl69

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4a5f09-cc78df9f5-nnsw5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4a5f09-5f5d6ffbff-vxtkm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-009a5f-5cbdb6898c-2h44b

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-009a5f-945d46bf5-bd7wg

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eda8e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eda8e2-c494b4ddb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eda8e2: serviceaccount "payload-processing-e2e-ipp-b-eda8e2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eda8e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eda8e2-c494b4ddb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eda8e2: serviceaccount "payload-processing-e2e-ipp-b-eda8e2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-ktjtd

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5

SuccessfulCreate

Created pod: e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-ktjtd

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-6f78de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-ktjtd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-ktjtd

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-6f78de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-6f78de

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eda8e2-c494b4ddb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-b286l

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-ktjtd

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-b286l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-b286l

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-b286l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-b286l

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-009a5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-009a5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f7957-74f686f95b-jnvkj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f7957-7c7cbff587-whkb5

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-6f78de-86c7bb469

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-6f78de-86c7bb469-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-6f78de: serviceaccount "payload-processing-e2e-praxis-b-6f78de" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-6f78de-86c7bb469

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-6f78de-86c7bb469-8wkcn

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-6f78de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-6f78de-86c7bb469 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-6f78de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-qmxmc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-6f78de: serviceaccount "payload-processing-e2e-praxis-b-6f78de" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-qmxmc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-qmxmc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-qmxmc

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6f78de-86c7bb469-8wkcn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6f78de-86c7bb469-8wkcn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-6f78de-86c7bb469-8wkcn

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6f78de-86c7bb469-8wkcn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-qmxmc

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4a5f09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4a5f09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-009a5f-openshift-default-c547f59b5-tncxc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

Unhealthy

Readiness probe failed: Get "http://10.132.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

ProbeError

Readiness probe error: Get "http://10.132.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-8f7957-openshift-default-8dc7996fc-bxs46

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-4e6649-openshift-default-68f8db9665

SuccessfulCreate

Created pod: e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

openshift-ingress

kubelet

e2e-praxis-b-4a5f09-openshift-default-854695dbf7-6tt84

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-4e6649-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-4e6649-openshift-default-68f8db9665 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-4e6649

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-4e6649

openshift-ingress

multus

e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

Unhealthy

Readiness probe failed: Get "http://10.133.0.143:15021/healthz/ready": read tcp 10.133.0.2:35446->10.133.0.143:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

ProbeError

Readiness probe error: Get "http://10.133.0.143:15021/healthz/ready": read tcp 10.133.0.2:35446->10.133.0.143:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4e6649-86c856c59

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-4e6649-86c856c59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4e6649: serviceaccount "payload-processing-e2e-praxis-a-4e6649" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4e6649-86c856c59

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-4e6649-86c856c59-zc2df

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-4e6649

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-4e6649-655b959b67 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4e6649-655b959b67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-9n7b8
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4e6649-655b959b67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4e6649: serviceaccount "payload-processing-e2e-praxis-a-4e6649" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-4e6649

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-4e6649-86c856c59 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4e6649-86c856c59-zc2df

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4e6649-86c856c59-zc2df

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-9n7b8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d8e217-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d8e217-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-9n7b8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4e6649-86c856c59-zc2df

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-9n7b8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-4e6649-86c856c59-zc2df

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-9n7b8

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6098d0-8579456655-vt6dq

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6098d0-54bf87cbc6-snhcx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eda8e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eda8e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-6098d0-openshift-default-5ccb49c75c-js265

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d8e217-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d8e217-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-e198eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-e198eb

openshift-ingress

replicaset-controller

e2e-praxis-b-e198eb-openshift-default-7554b6b489

SuccessfulCreate

Created pod: e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

openshift-ingress

deployment-controller

e2e-praxis-b-e198eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-e198eb-openshift-default-7554b6b489 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

ProbeError

Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eda8e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eda8e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eda8e2-5ccd55b8ff-ktjtd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eda8e2-c494b4ddb-b286l

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-e198eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-e198eb-7bdccc957 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e198eb-7bdccc957

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-e198eb-7bdccc957-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e198eb: serviceaccount "payload-processing-e2e-praxis-b-e198eb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e198eb-7bdccc957

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-qnbrn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e198eb: serviceaccount "payload-processing-e2e-praxis-b-e198eb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-e198eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-qnbrn

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-qnbrn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-qnbrn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-qnbrn

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49

SuccessfulCreate

Created pod: e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

openshift-ingress

kubelet

e2e-ipp-b-eda8e2-openshift-default-c8f649447-rggwd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-dfd356

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-dfd356

openshift-ingress

deployment-controller

e2e-praxis-a-dfd356-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 8 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-dfd356

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-dfd356: serviceaccount "payload-processing-e2e-praxis-a-dfd356" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-2nldm
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4e6649-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-6qjtx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4e6649-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-dfd356

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-dfd356: serviceaccount "payload-processing-e2e-praxis-a-dfd356" not found
(x6)

openshift-ingress

kubelet

e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-6qjtx

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-6qjtx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-6qjtx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-6qjtx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-2nldm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-2nldm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-2nldm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-2nldm

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

Unhealthy

Startup probe failed: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

ProbeError

Startup probe error: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e198eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e198eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6f78de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6f78de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 9 to 10
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4e6649-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4e6649-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 8 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

Created

Container created
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

Started

Container started

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4e6649-86c856c59-zc2df

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4e6649-655b959b67-9n7b8

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-56e6db-openshift-default-bf78764b5

SuccessfulCreate

Created pod: e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

openshift-ingress

deployment-controller

e2e-praxis-b-56e6db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-56e6db-openshift-default-bf78764b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-56e6db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-56e6db

openshift-ingress

multus

e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

ProbeError

Startup probe error: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

Unhealthy

Startup probe failed: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-dzq7j

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-56e6db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-56e6db-5b5876fcc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-56e6db: serviceaccount "payload-processing-e2e-praxis-b-56e6db" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-56e6db-5b5876fcc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-56e6db-5b5876fcc-6pjkk
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dfd356-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-56e6db-5b5876fcc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-56e6db-5b5876fcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-56e6db: serviceaccount "payload-processing-e2e-praxis-b-56e6db" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dfd356-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-56e6db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79 from 0 to 1
(x8)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-56e6db-5b5876fcc-6pjkk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-dzq7j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-56e6db-5b5876fcc-6pjkk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-56e6db-5b5876fcc-6pjkk

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-56e6db-5b5876fcc-6pjkk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-dzq7j

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-dzq7j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-dzq7j

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6f78de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-4e6649-openshift-default-68f8db9665-ngbl6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6f78de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-m6g9w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-m6g9w

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-6p9mh
(x6)

openshift-ingress

kubelet

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e198eb-85dcddcc5f-qnbrn

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e198eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e198eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e198eb-7bdccc957-tj97z

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.156:50052" within 1s: context deadline exceeded

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 8 to 7

openshift-ingress

kubelet

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-sgx68

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

ProbeError

Readiness probe error: Get "http://10.132.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e198eb-openshift-default-7554b6b489-b2wfc

Unhealthy

Readiness probe failed: Get "http://10.132.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfd356-7f4db9cc6c-6qjtx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfd356-84b4fdcbdc-2nldm

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dfd356-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dfd356-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

ProbeError

Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

Unhealthy

Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-dfd356-openshift-default-5cd7cbfc49-kh878

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-56e6db-5b5876fcc-6pjkk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-56e6db-7c5f5cdb79-dzq7j

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-47e1c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-47e1c2

openshift-ingress

replicaset-controller

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc

SuccessfulCreate

Created pod: e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

openshift-ingress

deployment-controller

e2e-shared-a-w4-47e1c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-47e1c2-openshift-default-77968876dc from 0 to 1

openshift-ingress

multus

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-47e1c2: serviceaccount "payload-processing-e2e-shared-a-w4-47e1c2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-47e1c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-47e1c2: serviceaccount "payload-processing-e2e-shared-a-w4-47e1c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-47e1c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulCreate

Created pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 7 to 10

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

Created

Container created

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

Started

Container started

openshift-ingress

multus

e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-56e6db-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-56e6db-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-86f5f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-86f5f0

openshift-ingress

deployment-controller

e2e-shared-a-w2-86f5f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857

SuccessfulCreate

Created pod: e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

openshift-ingress

multus

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-56e6db-openshift-default-bf78764b5-8t484

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-rqnxf

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-57npd

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-86f5f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-86f5f0: serviceaccount "payload-processing-e2e-shared-a-w2-86f5f0" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-86f5f0: serviceaccount "payload-processing-e2e-shared-a-w2-86f5f0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-86f5f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-rqnxf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-57npd

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-57npd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-57npd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-57npd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-rqnxf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-rqnxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-rqnxf

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-b6b6f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-b6b6f4

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulCreate

Created pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

openshift-ingress

multus

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-b6b6f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-b6b6f4: serviceaccount "payload-processing-e2e-shared-a-w1-b6b6f4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-b6b6f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-6szp7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-hflxn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-b6b6f4: serviceaccount "payload-processing-e2e-shared-a-w1-b6b6f4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-6szp7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-6szp7

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-6szp7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-6szp7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-hflxn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-hflxn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-hflxn

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-hflxn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-1e2281

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-1e2281

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-1e2281

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-1e2281: serviceaccount "payload-processing-e2e-shared-a-w0-1e2281" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-1e2281: serviceaccount "payload-processing-e2e-shared-a-w0-1e2281" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-1e2281

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-9165c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-9165c3

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-9165c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-9165c3-7ccd478485 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-9165c3: serviceaccount "payload-processing-e2e-shared-b-w4-9165c3" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-9165c3: serviceaccount "payload-processing-e2e-shared-b-w4-9165c3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-9165c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-86f5f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-86f5f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b1a788

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b1a788

openshift-ingress

deployment-controller

e2e-shared-b-w2-b1a788-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b1a788-openshift-default-f86c5f547 from 0 to 1
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d8e217-7d5dc8cdd9-xb99c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulCreate

Created pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d8e217-7bfb76d699-sn9cd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-47e1c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-47e1c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b1a788

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-2961d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-2961d5

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b1a788: serviceaccount "payload-processing-e2e-shared-b-w2-b1a788" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b1a788

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b1a788: serviceaccount "payload-processing-e2e-shared-b-w2-b1a788" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f

SuccessfulCreate

Created pod: e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

openshift-ingress

deployment-controller

e2e-shared-b-w1-2961d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-d8e217-openshift-default-7d8b8df87c-npgds

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-2961d5: serviceaccount "payload-processing-e2e-shared-b-w1-2961d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-2961d5-98554786c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-2961d5-98554786c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-2961d5-98554786c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-2961d5: serviceaccount "payload-processing-e2e-shared-b-w1-2961d5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-2961d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-2961d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-2961d5-98554786c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6f78de-86c7bb469-8wkcn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6f78de-bf5596d8c-qmxmc

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c

SuccessfulCreate

Created pod: e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

openshift-ingress

deployment-controller

e2e-shared-b-w0-7771bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-7771bf-openshift-default-b8d97467c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-7771bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-7771bf

openshift-ingress

multus

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

ProbeError

Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

Unhealthy

Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-7771bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-7771bf-76f4975979 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-7771bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-7771bf: serviceaccount "payload-processing-e2e-shared-b-w0-7771bf" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-7771bf-76f4975979

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-7771bf-76f4975979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-7771bf: serviceaccount "payload-processing-e2e-shared-b-w0-7771bf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-7771bf-76f4975979

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-6f78de-openshift-default-5bdcbfdfd5-v7cnm

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-47e1c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-47e1c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-86f5f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-86f5f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

Unhealthy

Readiness probe failed: Get "http://10.132.0.194:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

ProbeError

Readiness probe error: Get "http://10.132.0.194:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-explicit-23a657-openshift-default-7db6744997

SuccessfulCreate

Created pod: e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

openshift-ingress

deployment-controller

e2e-explicit-23a657-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-23a657-openshift-default-7db6744997 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-23a657

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-23a657

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulCreate

Created pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 1 to 4

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulCreate

Created pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulCreate

Created pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

openshift-ingress

multus

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-23a657-8564c67867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-23a657-8564c67867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-23a657: serviceaccount "payload-processing-e2e-explicit-23a657" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-23a657

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-23a657-59f8bdd477 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-23a657-8564c67867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-23a657-59f8bdd477

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-23a657-59f8bdd477-7lhz8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-23a657

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-23a657-8564c67867 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-23a657-59f8bdd477

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-23a657-59f8bdd477-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-23a657: serviceaccount "payload-processing-e2e-explicit-23a657" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-23a657-59f8bdd477-7lhz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m

Started

Container started

openshift-ingress

multus

payload-processing-e2e-explicit-23a657-59f8bdd477-7lhz8

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

Unhealthy

Startup probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

ProbeError

Startup probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

openshift-ingress

kubelet

payload-processing-e2e-explicit-23a657-59f8bdd477-7lhz8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-23a657-59f8bdd477-7lhz8

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 1 to 4

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulCreate

Created pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w2-b1a788-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b1a788-openshift-default-f86c5f547 from 1 to 4

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

Unhealthy

Startup probe failed: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulCreate

Created pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

openshift-ingress

multus

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulCreate

Created pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

ProbeError

Startup probe error: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

ProbeError

Startup probe error: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

Unhealthy

Startup probe failed: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulDelete

Deleted pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-fj7hg

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w3-a37cf0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a37cf0-openshift-default-d9d86696c from 5 to 4
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

Unhealthy

Readiness probe failed: Get "http://10.132.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

ProbeError

Readiness probe error: Get "http://10.132.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

ProbeError

Startup probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

Unhealthy

Startup probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulCreate

Created pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulCreate

Created pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

Unhealthy

Startup probe failed: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulCreate

Created pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulCreate

Created pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

ProbeError

Startup probe error: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

Unhealthy

Liveness probe failed: Get "https://10.132.0.46:8000/health": context deadline exceeded

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

Started

Container started

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4pb5f

Unhealthy

Readiness probe failed: Get "https://10.132.0.46:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

Created

Container created

openshift-ingress

multus

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes
(x9)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

Unhealthy

Startup probe failed: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

Unhealthy

Readiness probe failed: Get "http://10.132.0.192:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

Unhealthy

Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

ProbeError

Startup probe error: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

ProbeError

Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

ProbeError

Readiness probe error: Get "http://10.132.0.192:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

Unhealthy

Readiness probe failed: Get "http://10.132.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

ProbeError

Readiness probe error: Get "http://10.132.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

Started

Container started

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

Created

Container created

openshift-ingress

multus

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

ProbeError

Startup probe error: Get "http://10.133.0.192:15021/healthz/ready": dial tcp 10.133.0.192:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

Unhealthy

Startup probe failed: Get "http://10.133.0.192:15021/healthz/ready": dial tcp 10.133.0.192:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

ProbeError

Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

Unhealthy

Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

Unhealthy

Startup probe failed: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

ProbeError

Startup probe error: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

Created

Container created
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

Unhealthy

Startup probe failed: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

ProbeError

Startup probe error: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

Unhealthy

Startup probe failed: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

ProbeError

Startup probe error: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

Unhealthy

Startup probe failed: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

ProbeError

Startup probe error: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-86f5f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-86f5f0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857

SuccessfulCreate

Created pod: e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

Created

Container created

openshift-ingress

multus

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-jkjqp
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b7gw6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-2961d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-2961d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-b7gw6

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

openshift-ingress

deployment-controller

e2e-shared-b-w2-b1a788-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b1a788-openshift-default-f86c5f547 from 4 to 6

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulCreate

Created pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulCreate

Created pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

ProbeError

Startup probe error: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

ProbeError

Startup probe error: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

Unhealthy

Startup probe failed: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

Unhealthy

Startup probe failed: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

Unhealthy

Startup probe failed: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

ProbeError

Startup probe error: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

ProbeError

Startup probe error: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

Unhealthy

Startup probe failed: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

ProbeError

Readiness probe error: Get "http://10.132.0.198:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

Unhealthy

Readiness probe failed: Get "http://10.132.0.198:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

ProbeError

Startup probe error: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

Unhealthy

Startup probe failed: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

ProbeError

Startup probe error: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

Unhealthy

Startup probe failed: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-23a657-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-23a657-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 8 to 10

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

(combined from similar events): Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

Started

Container started

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

ProbeError

Startup probe error: Get "http://10.132.0.198:15021/healthz/ready": dial tcp 10.132.0.198:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

Unhealthy

Startup probe failed: Get "http://10.132.0.198:15021/healthz/ready": dial tcp 10.132.0.198:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

ProbeError

Startup probe error: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

Unhealthy

Startup probe failed: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-23a657-59f8bdd477-7lhz8

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-23a657-8564c67867-lkh9m

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-plugins-e2e-explicit-23a657" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-23a657-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-23a657-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-2961d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-2961d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-noten-66d558

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-66d558

openshift-ingress

deployment-controller

e2e-noten-66d558-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-66d558-openshift-default-f89bd98b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-66d558-openshift-default-f89bd98b5

SuccessfulCreate

Created pod: e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

openshift-ingress

kubelet

e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

Created

Container created

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-23a657-openshift-default-7db6744997-ctqqs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

Started

Container started

openshift-ingress

kubelet

e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-66d558-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-66d558-openshift-default-f89bd98b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-66d558-openshift-default-f89bd98b5

FailedCreate

Error creating: pods "e2e-noten-66d558-openshift-default-f89bd98b5-" is forbidden: error looking up service account openshift-ingress/e2e-noten-66d558-openshift-default: serviceaccount "e2e-noten-66d558-openshift-default" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-66d558-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-66d558-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

ProbeError

Readiness probe error: Get "http://10.132.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

Unhealthy

Readiness probe failed: Get "http://10.132.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-66d558-openshift-default-f89bd98b5-6q5z4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-7771bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-7771bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

Unhealthy

Startup probe failed: Get "http://10.132.0.195:15021/healthz/ready": dial tcp 10.132.0.195:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

ProbeError

Startup probe error: Get "http://10.132.0.195:15021/healthz/ready": dial tcp 10.132.0.195:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-7771bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-7771bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7347-4cf539

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7347-4cf539

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7347-4cf539

Started

Container started

opendatahub

kubelet

test-curl-7347-4cf539

Created

Container created

opendatahub

kubelet

test-curl-7347-8ca5b6

Started

Container started

opendatahub

kubelet

test-curl-7347-8ca5b6

Created

Container created

opendatahub

kubelet

test-curl-7347-8ca5b6

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7347-8ca5b6

AddedInterface

Add eth0 [10.133.0.201/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7347-4cf539

Killing

Stopping container test-curl-7347-4cf539

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-0f0baf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-0f0baf

openshift-ingress

deployment-controller

e2e-shared-a-w3-0f0baf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5 from 0 to 1

opendatahub

kubelet

test-curl-7347-8ca5b6

Killing

Stopping container test-curl-7347-8ca5b6

openshift-ingress

replicaset-controller

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5

SuccessfulCreate

Created pod: e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

openshift-ingress

multus

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

ProbeError

Startup probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

Unhealthy

Startup probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-0f0baf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0f0baf: serviceaccount "payload-processing-e2e-shared-a-w3-0f0baf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-d2zdm

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-0f0baf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0f0baf: serviceaccount "payload-processing-e2e-shared-a-w3-0f0baf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-nr6nl

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-d2zdm

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-nr6nl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-d2zdm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-nr6nl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-d2zdm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-nr6nl

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-nr6nl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-d2zdm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0f0baf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0f0baf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0f0baf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0f0baf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-72f605

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-72f605

openshift-ingress

replicaset-controller

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87

SuccessfulCreate

Created pod: e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

openshift-ingress

deployment-controller

e2e-shared-b-w3-72f605-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kxhd7

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-5ppgg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-z6lxr
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-72f605: serviceaccount "payload-processing-e2e-shared-b-w3-72f605" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-72f605

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-72f605

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-gnbw6
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-72f605: serviceaccount "payload-processing-e2e-shared-b-w3-72f605" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-gnbw6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-z6lxr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-gnbw6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-gnbw6

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-z6lxr

AddedInterface

Add eth0 [10.132.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-z6lxr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-z6lxr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-gnbw6

Started

Container started

opendatahub

kubelet

test-curl-7341-31ce46

Created

Container created

opendatahub

kubelet

test-curl-7341-31ce46

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7341-31ce46

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7341-31ce46

Started

Container started

opendatahub

kubelet

test-curl-7341-31ce46

Killing

Stopping container test-curl-7341-31ce46

opendatahub

kubelet

test-curl-7350-c40f5f

Created

Container created

opendatahub

multus

test-curl-7350-c40f5f

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7350-c40f5f

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7350-c40f5f

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-42d786

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-42d786

openshift-ingress

replicaset-controller

e2e-extmod-a-42d786-openshift-default-776544c777

SuccessfulCreate

Created pod: e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

openshift-ingress

deployment-controller

e2e-extmod-a-42d786-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-42d786-openshift-default-776544c777 from 0 to 1

opendatahub

kubelet

test-curl-7350-c40f5f

Killing

Stopping container test-curl-7350-c40f5f

opendatahub

multus

test-curl-7350-583613

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7350-583613

Created

Container created

opendatahub

kubelet

test-curl-7350-583613

Started

Container started

opendatahub

kubelet

test-curl-7350-583613

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7350-4466f5

Started

Container started

opendatahub

kubelet

test-curl-7350-583613

Killing

Stopping container test-curl-7350-583613

opendatahub

kubelet

test-curl-7350-4466f5

Created

Container created

opendatahub

kubelet

test-curl-7350-4466f5

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7350-4466f5

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7350-046cae

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-42d786-77876d7c85

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-42d786-77876d7c85

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-42d786-77876d7c85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-42d786: serviceaccount "payload-processing-e2e-extmod-a-42d786" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-42d786: serviceaccount "payload-processing-e2e-extmod-a-42d786" not found

opendatahub

multus

test-curl-7350-046cae

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7350-046cae

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-42d786

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-42d786-cfc454fff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-42d786

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-42d786-77876d7c85 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k

opendatahub

kubelet

test-curl-7350-046cae

Created

Container created

opendatahub

kubelet

test-curl-7350-4466f5

Killing

Stopping container test-curl-7350-4466f5

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k

AddedInterface

Add eth0 [10.132.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59

Started

Container started

opendatahub

kubelet

test-curl-7350-046cae

Killing

Stopping container test-curl-7350-046cae

openshift-ingress

deployment-controller

e2e-extmod-a-5ec436-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-5ec436-openshift-default-58bbc5478f from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-5ec436

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-5ec436

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 10 to 8

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-gc2vb

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-tcxlh

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-5ec436-cd8fd9675

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-5ec436-cd8fd9675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-5ec436: serviceaccount "payload-processing-e2e-extmod-a-5ec436" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-5ec436

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-5ec436-cd8fd9675 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-4ea582

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-4ea582

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-5ec436

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-5ec436: serviceaccount "payload-processing-e2e-extmod-a-5ec436" not found

openshift-ingress

replicaset-controller

e2e-autores-4ea582-openshift-default-9b47c7c49

SuccessfulCreate

Created pod: e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

openshift-ingress

deployment-controller

e2e-autores-4ea582-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4ea582-openshift-default-9b47c7c49 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-5ec436-cd8fd9675

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-4ea582

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-4ea582-66c9c7b47f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4ea582-59fc9c7867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-4ea582-59fc9c7867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4ea582: serviceaccount "payload-processing-e2e-autores-4ea582" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-4ea582

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-4ea582-59fc9c7867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4ea582-59fc9c7867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-4ea582-59fc9c7867-7gpck
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4ea582-66c9c7b47f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-4ea582-66c9c7b47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4ea582: serviceaccount "payload-processing-e2e-autores-4ea582" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4ea582-66c9c7b47f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-4ea582-66c9c7b47f-jpjdk

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4ea582-59fc9c7867-7gpck

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-4ea582-66c9c7b47f-jpjdk

AddedInterface

Add eth0 [10.133.0.212/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-4ea582-59fc9c7867-7gpck

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4ea582-59fc9c7867-7gpck

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-4ea582-66c9c7b47f-jpjdk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-4ea582-66c9c7b47f-jpjdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4ea582-59fc9c7867-7gpck

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-4ea582-66c9c7b47f-jpjdk

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-a8e574-openshift-default-658b84d485

SuccessfulCreate

Created pod: e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

openshift-ingress

deployment-controller

e2e-extmod-a-a8e574-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a8e574-openshift-default-658b84d485 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-a8e574

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a8e574

openshift-ingress

multus

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

ProbeError

Readiness probe error: Get "http://10.132.0.226:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

Unhealthy

Readiness probe failed: Get "http://10.132.0.226:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a8e574-bfb58f65f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-a8e574-bfb58f65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a8e574: serviceaccount "payload-processing-e2e-extmod-a-a8e574" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-a8e574

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-a8e574-bfb58f65f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a8e574-bfb58f65f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-a8e574

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-a8e574-6866d758c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a8e574: serviceaccount "payload-processing-e2e-extmod-a-a8e574" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-807c08-openshift-default-56bd9457

SuccessfulCreate

Created pod: e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

ProbeError

Startup probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

Unhealthy

Startup probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-tw9kl

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

deployment-controller

e2e-extmod-a-807c08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-807c08-openshift-default-56bd9457 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-807c08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-807c08

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-tw9kl

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tw9kl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tw9kl

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tw9kl

Started

Container started

openshift-ingress

multus

e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-72f605-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-72f605-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tw9kl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tw9kl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-807c08-56f5765679

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-807c08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-327608-openshift-default-569bd4db89

SuccessfulCreate

Created pod: e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-807c08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-807c08-56f5765679 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-807c08: serviceaccount "payload-processing-e2e-extmod-a-807c08" not found

openshift-ingress

deployment-controller

e2e-extmod-b-327608-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-327608-openshift-default-569bd4db89 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-807c08-56f5765679

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-807c08-56f5765679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-807c08: serviceaccount "payload-processing-e2e-extmod-a-807c08" not found

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-327608

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-327608

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-327608-64955f5f6f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-327608-64955f5f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-327608: serviceaccount "payload-processing-e2e-extmod-b-327608" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-327608

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-327608-895868c7f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-327608

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-327608-64955f5f6f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-327608-895868c7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-327608-895868c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-327608: serviceaccount "payload-processing-e2e-extmod-b-327608" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-327608-64955f5f6f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-327608-895868c7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-1ef96f-openshift-default-5995666b49

SuccessfulCreate

Created pod: e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

openshift-ingress

deployment-controller

e2e-extmod-b-1ef96f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-1ef96f-openshift-default-5995666b49 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-1ef96f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-1ef96f

openshift-ingress

multus

e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-327608-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-t5p9t

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-327608-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-1ef96f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-1ef96f-776b648c8c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-1ef96f-776b648c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-1ef96f: serviceaccount "payload-processing-e2e-extmod-b-1ef96f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-1ef96f: serviceaccount "payload-processing-e2e-extmod-b-1ef96f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-1ef96f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-1ef96f-776b648c8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-1ef96f-776b648c8c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d

AddedInterface

Add eth0 [10.133.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulDelete

Deleted pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-a37cf0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a37cf0-openshift-default-d9d86696c from 4 to 3

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-ldf69

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-72f605-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-72f605-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-4gg9k

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-x7pgc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-vrb5b

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 8 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-5kmr9

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-6jqff

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9

SuccessfulCreate

Created pod: e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

openshift-ingress

deployment-controller

e2e-extmod-b-5c3c1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-5c3c1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-5c3c1f

openshift-ingress

replicaset-controller

e2e-autores-4ea582-openshift-default-9b47c7c49

SuccessfulCreate

Created pod: e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

openshift-ingress

deployment-controller

e2e-autores-4ea582-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4ea582-openshift-default-9b47c7c49 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4ea582-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-autores-4ea582-openshift-default-9b47c7c49

SuccessfulCreate

Created pod: e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

openshift-ingress

multus

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

Created

Container created

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

Started

Container started

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

Started

Container started

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

Created

Container created

openshift-ingress

multus

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

Unhealthy

Readiness probe failed: Get "http://10.132.0.241:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

ProbeError

Readiness probe error: Get "http://10.132.0.241:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-5c3c1f: serviceaccount "payload-processing-e2e-extmod-b-5c3c1f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-5c3c1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-5c3c1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-5c3c1f-7d6c46555 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-5c3c1f: serviceaccount "payload-processing-e2e-extmod-b-5c3c1f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f
(x6)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

Unhealthy

Startup probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

ProbeError

Startup probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

openshift-ingress

deployment-controller

e2e-extmod-a-5ec436-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-5ec436-openshift-default-58bbc5478f from 1 to 4

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

AddedInterface

Add eth0 [10.132.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v

AddedInterface

Add eth0 [10.132.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

Created

Container created

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

AddedInterface

Add eth0 [10.132.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-bee8f6-openshift-default-58f76f6545

SuccessfulCreate

Created pod: e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

openshift-ingress

deployment-controller

e2e-extmod-b-bee8f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-bee8f6-openshift-default-58f76f6545 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-bee8f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-bee8f6
(x2)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

Unhealthy

Readiness probe failed: Get "http://10.132.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

ProbeError

Readiness probe error: Get "http://10.132.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4ea582-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4ea582-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

Unhealthy

Startup probe failed: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

Unhealthy

Startup probe failed: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

ProbeError

Startup probe error: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

ProbeError

Startup probe error: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

Unhealthy

Startup probe failed: Get "http://10.132.0.241:15021/healthz/ready": dial tcp 10.132.0.241:15021: connect: connection refused
(x3)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bee8f6: serviceaccount "payload-processing-e2e-extmod-b-bee8f6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-bee8f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-bee8f6-c879f6577 from 0 to 1
(x11)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

ProbeError

Startup probe error: Get "http://10.132.0.241:15021/healthz/ready": dial tcp 10.132.0.241:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

Unhealthy

Startup probe failed: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

ProbeError

Startup probe error: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bee8f6-c879f6577

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-bee8f6-c879f6577-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bee8f6: serviceaccount "payload-processing-e2e-extmod-b-bee8f6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bee8f6-c879f6577

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-bee8f6-c879f6577-9l726

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-bee8f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z

openshift-ingress

multus

payload-processing-e2e-extmod-b-bee8f6-c879f6577-9l726

AddedInterface

Add eth0 [10.133.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z

AddedInterface

Add eth0 [10.133.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bee8f6-c879f6577-9l726

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bee8f6-c879f6577-9l726

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z

Started

Container started
(x4)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bee8f6-c879f6577-9l726

Started

Container started
(x10)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

Unhealthy

Startup probe failed: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

ProbeError

Startup probe error: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

Unhealthy

Readiness probe failed: Get "http://10.133.0.213:15021/healthz/ready": read tcp 10.133.0.2:50048->10.133.0.213:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

ProbeError

Readiness probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

ProbeError

Readiness probe error: Get "http://10.133.0.213:15021/healthz/ready": read tcp 10.133.0.2:50048->10.133.0.213:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

Unhealthy

Readiness probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4ea582-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4ea582-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-807c08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-807c08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

ProbeError

Startup probe error: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

Unhealthy

Startup probe failed: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh

Unhealthy

Startup probe failed: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh

ProbeError

Startup probe error: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a8e574-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a8e574-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4ea582-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-autores-4ea582-openshift-default-9b47c7c49

SuccessfulCreate

Created pod: e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

openshift-ingress

kubelet

payload-processing-e2e-autores-4ea582-66c9c7b47f-jpjdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4ea582-59fc9c7867-7gpck

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-autores-4ea582-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4ea582-openshift-default-9b47c7c49 from 3 to 4

openshift-ingress

multus

e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

Created

Container created

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

ProbeError

Startup probe error: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

Unhealthy

Startup probe failed: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-dnt4z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-5ec436-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-5ec436-openshift-default-58bbc5478f from 4 to 8

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-74sb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-krnwl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

Created

Container created

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

AddedInterface

Add eth0 [10.133.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

Started

Container started

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-4ea582-openshift-default-9b47c7c49-h5r7b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-36a991-openshift-default-66bfb884c7

SuccessfulCreate

Created pod: e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a8e574-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a8e574-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-36a991

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-36a991

openshift-ingress

deployment-controller

e2e-extmod-a-36a991-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-36a991-openshift-default-66bfb884c7 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

Unhealthy

Startup probe failed: Get "http://10.133.0.232:15021/healthz/ready": dial tcp 10.133.0.232:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

ProbeError

Startup probe error: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

Unhealthy

Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

Unhealthy

Startup probe failed: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

ProbeError

Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

ProbeError

Startup probe error: Get "http://10.133.0.232:15021/healthz/ready": dial tcp 10.133.0.232:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-807c08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-36a991-9dfd66d49

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-36a991-9dfd66d49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-36a991: serviceaccount "payload-processing-e2e-extmod-a-36a991" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-36a991-9dfd66d49

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-36a991

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-36a991-9dfd66d49 from 0 to 1

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

Unhealthy

Readiness probe failed: Get "http://10.132.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-36a991: serviceaccount "payload-processing-e2e-extmod-a-36a991" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-36a991

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc from 0 to 1

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

ProbeError

Readiness probe error: Get "http://10.132.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-807c08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j

AddedInterface

Add eth0 [10.133.0.233/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r

AddedInterface

Add eth0 [10.133.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulCreate

Created pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-5ec436-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-5ec436-openshift-default-58bbc5478f from 8 to 9

openshift-ingress

multus

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-327608-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-327608-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5c3c1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5c3c1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

ProbeError

Startup probe error: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

Unhealthy

Startup probe failed: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

ProbeError

Startup probe error: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

Unhealthy

Startup probe failed: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

ProbeError

Startup probe error: Get "http://10.132.0.244:15021/healthz/ready": dial tcp 10.132.0.244:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

Unhealthy

Startup probe failed: Get "http://10.132.0.244:15021/healthz/ready": dial tcp 10.132.0.244:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 10 to 8

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-nrvdg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-79sff

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5c3c1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5c3c1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-b-bee8f6-openshift-default-58f76f6545

SuccessfulCreate

Created pod: e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

openshift-ingress

deployment-controller

e2e-extmod-b-bee8f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-bee8f6-openshift-default-58f76f6545 from 1 to 4

openshift-ingress

multus

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-bee8f6-openshift-default-58f76f6545

SuccessfulCreate

Created pod: e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

openshift-ingress

replicaset-controller

e2e-extmod-b-bee8f6-openshift-default-58f76f6545

SuccessfulCreate

Created pod: e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bee8f6-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

ProbeError

Startup probe error: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

Unhealthy

Startup probe failed: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

Unhealthy

Startup probe failed: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1ef96f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1ef96f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

ProbeError

Startup probe error: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-b-2db162-openshift-default-56b7cbc657

SuccessfulCreate

Created pod: e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

openshift-ingress

deployment-controller

e2e-extmod-b-2db162-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2db162-openshift-default-56b7cbc657 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2db162

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2db162
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bee8f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bee8f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

Unhealthy

Readiness probe failed: Get "http://10.132.0.251:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

ProbeError

Readiness probe error: Get "http://10.132.0.251:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-bee8f6-openshift-default-58f76f6545

SuccessfulCreate

Created pod: e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bee8f6-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-bee8f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-bee8f6-openshift-default-58f76f6545 from 4 to 5
(x6)

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

ProbeError

Startup probe error: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

Unhealthy

Startup probe failed: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-36a991-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-36a991-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-d95tn

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 8 to 7

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

Unhealthy

Startup probe failed: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

ProbeError

Startup probe error: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-36a991-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-36a991-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 8 to 7

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-4wnqm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-h8h4b

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 7 to 6

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-sd6xn

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 8 to 6

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

ProbeError

Readiness probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-57wxb

Unhealthy

Readiness probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-jzt5b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-r4pz9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-r7jgj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-b1a788-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-b1a788-openshift-default-f86c5f547 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

Started

Container started

openshift-ingress

multus

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused body:
(x12)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2db162-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2db162

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2db162-75bf5bd459 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2db162-75bf5bd459

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2db162-75bf5bd459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2db162: serviceaccount "payload-processing-e2e-extmod-b-2db162" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2db162

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2db162-5776877f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2db162-5776877f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2db162-5776877f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2db162-5776877f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2db162: serviceaccount "payload-processing-e2e-extmod-b-2db162" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2db162-75bf5bd459

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-rqj8h

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw

AddedInterface

Add eth0 [10.133.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

Unhealthy

Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

ProbeError

Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-2wrzq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 8 to 7
(x13)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2db162-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-42d786-openshift-default-776544c777

SuccessfulCreate

Created pod: e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

openshift-ingress

multus

e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-42d786-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-42d786-openshift-default-776544c777

SuccessfulCreate

Created pod: e2e-extmod-a-42d786-openshift-default-776544c777-97z24

openshift-ingress

multus

e2e-extmod-a-42d786-openshift-default-776544c777-97z24

AddedInterface

Add eth0 [10.132.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-42d786-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-42d786-openshift-default-776544c777 from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-a-42d786-openshift-default-776544c777

SuccessfulCreate

Created pod: e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-97z24

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-97z24

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-97z24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

Unhealthy

Startup probe failed: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

ProbeError

Startup probe error: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-97z24

Unhealthy

Startup probe failed: Get "http://10.132.1.13:15021/healthz/ready": dial tcp 10.132.1.13:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-97z24

ProbeError

Startup probe error: Get "http://10.132.1.13:15021/healthz/ready": dial tcp 10.132.1.13:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-42d786-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-42d786-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

ProbeError

Startup probe error: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

Unhealthy

Startup probe failed: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-r6t94

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8qb82

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-42d786-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-42d786-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 6 to 5

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-9lp7m

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-b1a788-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-b1a788-openshift-default-f86c5f547 from 5 to 4

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-5pshm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-cmgcj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-zkp5v

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 7 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-42d786-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-42d786-openshift-default-776544c777 from 4 to 5

openshift-ingress

multus

e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-42d786-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-42d786-openshift-default-776544c777

SuccessfulCreate

Created pod: e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc
(x6)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc

Unhealthy

Startup probe failed: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc

ProbeError

Startup probe error: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-cbbcc59d from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-cbbcc59d

SuccessfulCreate

Created pod: payload-processing-external-model-cbbcc59d-kwr9f
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-cbbcc59d

FailedCreate

Error creating: pods "payload-processing-external-model-cbbcc59d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-cbbcc59d-kwr9f

Started

Container started

models-as-a-service

multus

payload-processing-external-model-cbbcc59d-kwr9f

AddedInterface

Add eth0 [10.133.0.250/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-cbbcc59d-kwr9f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-cbbcc59d-kwr9f

Created

Container created

models-as-a-service

multus

payload-processing-external-model-769b787cbf-h9x98

AddedInterface

Add eth0 [10.133.0.251/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-769b787cbf from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-769b787cbf

SuccessfulCreate

Created pod: payload-processing-external-model-769b787cbf-h9x98

models-as-a-service

kubelet

payload-processing-external-model-769b787cbf-h9x98

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-769b787cbf-h9x98

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-769b787cbf-h9x98

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-cbbcc59d-kwr9f

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-cbbcc59d

SuccessfulDelete

Deleted pod: payload-processing-external-model-cbbcc59d-kwr9f

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-cbbcc59d from 1 to 0
(x5)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Unhealthy

Liveness probe failed: Get "https://10.132.0.49:8000/health": context deadline exceeded
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-mdxxk

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-mdxxk

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-msm5t

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-65c448b547 from 8 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-cmqs4

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-cmqs4

AddedInterface

Add eth0 [10.132.1.21/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-cmqs4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-cmqs4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-cmqs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-msm5t

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-msm5t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-msm5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-msm5t

AddedInterface

Add eth0 [10.133.0.253/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6fc469f668 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-6fc469f668-5rmnj

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6fc469f668-5rmnj

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6fc469f668-5rmnj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6fc469f668-5rmnj

AddedInterface

Add eth0 [10.133.0.254/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-6fc469f668

SuccessfulCreate

Created pod: payload-processing-external-model-6fc469f668-5rmnj
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-msm5t

ProbeError

Startup probe error: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-msm5t

Unhealthy

Startup probe failed: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-cmqs4

Unhealthy

Startup probe failed: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-cmqs4

ProbeError

Startup probe error: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-769b787cbf-h9x98

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-769b787cbf

SuccessfulDelete

Deleted pod: payload-processing-external-model-769b787cbf-h9x98

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-769b787cbf from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-d58b5b6b9-n6bqb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-d58b5b6b9-n6bqb

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-d58b5b6b9-n6bqb

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-d58b5b6b9 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-d58b5b6b9

SuccessfulCreate

Created pod: payload-processing-external-model-d58b5b6b9-n6bqb

models-as-a-service

replicaset-controller

payload-processing-external-model-d58b5b6b9

SuccessfulDelete

Deleted pod: payload-processing-external-model-d58b5b6b9-n6bqb

models-as-a-service

multus

payload-processing-external-model-d58b5b6b9-n6bqb

AddedInterface

Add eth0 [10.133.1.0/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-d58b5b6b9 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-d58b5b6b9-n6bqb

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-75456797bd

SuccessfulCreate

Created pod: payload-processing-external-model-75456797bd-d542n

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-75456797bd from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-75456797bd-d542n

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

models-as-a-service

kubelet

payload-processing-external-model-75456797bd-d542n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2

Killing

Stopping container istio-proxy

models-as-a-service

kubelet

payload-processing-external-model-75456797bd-d542n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-75456797bd-d542n

AddedInterface

Add eth0 [10.133.1.2/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-7llc2
(x3)

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 4 to 3

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6fc469f668 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-6fc469f668

SuccessfulDelete

Deleted pod: payload-processing-external-model-6fc469f668-5rmnj

models-as-a-service

kubelet

payload-processing-external-model-6fc469f668-5rmnj

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-j4vtp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-6g8bs

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-bzvrn

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 5 to 4

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-9dwdj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-8txbg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-b1a788-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-b1a788-openshift-default-f86c5f547 from 4 to 3

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-bdsqb

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dp2bg

Killing

Stopping container istio-proxy

models-as-a-service

replicaset-controller

payload-processing-external-model-56fb475f76

SuccessfulCreate

Created pod: payload-processing-external-model-56fb475f76-2gk4p

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-2gk4p

Started

Container started

models-as-a-service

multus

payload-processing-external-model-56fb475f76-2gk4p

AddedInterface

Add eth0 [10.133.1.11/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-2gk4p

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-2gk4p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-7875b97c67

SuccessfulCreate

Created pod: payload-processing-external-model-7875b97c67-mgttk

models-as-a-service

replicaset-controller

payload-processing-external-model-56fb475f76

SuccessfulDelete

Deleted pod: payload-processing-external-model-56fb475f76-2gk4p

models-as-a-service

replicaset-controller

payload-processing-external-model-56fb475f76

SuccessfulCreate

Created pod: payload-processing-external-model-56fb475f76-fvjmx

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-56fb475f76 from 0 to 1
(x2)

models-as-a-service

kubelet

payload-processing-external-model-7875b97c67-mgttk

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-ecf6b1cb54e8" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-7875b97c67

SuccessfulDelete

Deleted pod: payload-processing-external-model-7875b97c67-mgttk

models-as-a-service

replicaset-controller

payload-processing-external-model-7875b97c67

SuccessfulCreate

Created pod: payload-processing-external-model-7875b97c67-r8hd4

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-fvjmx

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-fvjmx

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-2gk4p

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-fvjmx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-56fb475f76-fvjmx

AddedInterface

Add eth0 [10.133.1.13/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-56fb475f76 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-56fb475f76

SuccessfulDelete

Deleted pod: payload-processing-external-model-56fb475f76-fvjmx

models-as-a-service

kubelet

payload-processing-external-model-7875b97c67-r8hd4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7875b97c67-r8hd4

AddedInterface

Add eth0 [10.133.1.14/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7875b97c67-r8hd4

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7875b97c67-r8hd4

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-fvjmx

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-56fb475f76

SuccessfulCreate

Created pod: payload-processing-external-model-56fb475f76-m7d62

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7875b97c67 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-7875b97c67-r8hd4

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7875b97c67

SuccessfulDelete

Deleted pod: payload-processing-external-model-7875b97c67-r8hd4

models-as-a-service

multus

payload-processing-external-model-56fb475f76-m7d62

AddedInterface

Add eth0 [10.133.1.15/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-m7d62

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-m7d62

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-m7d62

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-a-78383f-openshift-default-5797f74797

SuccessfulCreate

Created pod: e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

openshift-ingress

deployment-controller

e2e-inf-a-78383f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-78383f-openshift-default-5797f74797 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-78383f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-78383f

openshift-ingress

multus

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

AddedInterface

Add eth0 [10.133.1.16/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-78383f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-78383f-8559948df9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-78383f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-78383f-8559948df9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-78383f-8559948df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-78383f: serviceaccount "payload-processing-e2e-inf-a-78383f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-78383f-8559948df9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-78383f: serviceaccount "payload-processing-e2e-inf-a-78383f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx

AddedInterface

Add eth0 [10.133.1.18/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75

AddedInterface

Add eth0 [10.133.1.17/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-75456797bd

SuccessfulDelete

Deleted pod: payload-processing-external-model-75456797bd-d542n

models-as-a-service

kubelet

payload-processing-external-model-75456797bd-d542n

Killing

Stopping container payload-processing
(x7)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled down replica set payload-processing-external-model-75456797bd from 1 to 0

openshift-ingress

gateway_labeler_controller

e2e-inf-b-658b8c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-658b8c

openshift-ingress

replicaset-controller

e2e-inf-b-658b8c-openshift-default-777bdf6b85

SuccessfulCreate

Created pod: e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

openshift-ingress

deployment-controller

e2e-inf-b-658b8c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-658b8c-openshift-default-777bdf6b85 from 0 to 1

openshift-ingress

multus

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-658b8c-8f4c6c479

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-658b8c-8f4c6c479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-658b8c: serviceaccount "payload-processing-e2e-inf-b-658b8c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-658b8c-8f4c6c479

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-658b8c: serviceaccount "payload-processing-e2e-inf-b-658b8c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-658b8c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-658b8c-8f4c6c479 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-658b8c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr

AddedInterface

Add eth0 [10.133.1.20/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr

AddedInterface

Add eth0 [10.133.1.19/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr

Created

Container created

openshift-ingress

kubelet

router-default-c7d5754d7-v6znk

Unhealthy

Readiness probe failed: Get "http://10.132.0.15:1936/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.242:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

router-default-c7d5754d7-v6znk

ProbeError

Readiness probe error: Get "http://10.132.0.15:1936/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.245:50052" within 1s: context deadline exceeded

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f56vl

Unhealthy

Readiness probe failed: Get "http://10.132.0.40:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-lx6js

Unhealthy

Liveness probe failed: Get "http://10.132.0.37:8081/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-789486f7c8-sx6g4

Unhealthy

Readiness probe failed: Get "http://10.132.0.36:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ljs7q

Unhealthy

Readiness probe failed: Get "http://10.132.0.39:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k9mfj

Unhealthy

Readiness probe failed: Get "http://10.132.0.38:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

ProbeError

Readiness probe error: Get "http://10.133.1.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

Unhealthy

Readiness probe failed: Get "http://10.133.1.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kserve-module-controller-manager-7566cf5fc8-tfbt9_7f7b0ab9-0758-495a-b1c3-4ef37f28be12

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-tfbt9_7f7b0ab9-0758-495a-b1c3-4ef37f28be12 stopped leading

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-tfbt9

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:8081/readyz": dial tcp 10.132.0.43:8081: connect: connection refused

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c8zlh

Unhealthy

Readiness probe failed: Get "https://10.132.0.48:8000/ready": context deadline exceeded

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c8zlh

Unhealthy

Liveness probe failed: Get "https://10.132.0.48:8000/health": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.193:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-78383f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-78383f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-tfbt9

Created

Container created
(x2)

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-tfbt9

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-tfbt9

Pulled

Container image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" already present on machine and can be accessed by the pod
(x11)

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

Unhealthy

Startup probe failed: Get "http://10.133.1.16:15021/healthz/ready": dial tcp 10.133.1.16:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

ProbeError

Startup probe error: Get "http://10.133.1.16:15021/healthz/ready": dial tcp 10.133.1.16:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-a-42d786-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-42d786-openshift-default-776544c777 from 5 to 4

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-42d786-openshift-default-776544c777

SuccessfulDelete

Deleted pod: e2e-extmod-a-42d786-openshift-default-776544c777-rdssf

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-42d786-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-78383f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-78383f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kserve-module-controller-manager-7566cf5fc8-tfbt9_48228da4-5504-44af-b503-1ec7b3e3d1c7

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-tfbt9_48228da4-5504-44af-b503-1ec7b3e3d1c7 became leader

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-fmn8z

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulDelete

Deleted pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulDelete

Deleted pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulDelete

Deleted pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

openshift-ingress

deployment-controller

e2e-extmod-a-5ec436-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-5ec436-openshift-default-58bbc5478f from 9 to 6

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-gglml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-jf85f

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-312f21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-312f21

openshift-ingress

deployment-controller

e2e-inf-a-312f21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-312f21-openshift-default-69765ddd69 from 0 to 1

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-312f21-openshift-default-69765ddd69

SuccessfulCreate

Created pod: e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

openshift-ingress

multus

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

ProbeError

Readiness probe error: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-rh5dj

Unhealthy

Readiness probe failed: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-312f21

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-312f21-56cc99d475 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-312f21

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-312f21-6984dd475 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-312f21-6984dd475

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-312f21-6984dd475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-312f21: serviceaccount "payload-processing-e2e-inf-a-312f21" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-312f21-56cc99d475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-312f21-56cc99d475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-312f21-56cc99d475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-312f21: serviceaccount "payload-processing-e2e-inf-a-312f21" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-312f21-6984dd475

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn

AddedInterface

Add eth0 [10.132.1.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

ProbeError

Readiness probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

Unhealthy

Readiness probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

Unhealthy

Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

ProbeError

Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-56fb475f76-m7d62

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-a-22dfc1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-22dfc1

openshift-ingress

replicaset-controller

e2e-inf-a-22dfc1-openshift-default-79f4d66d95

SuccessfulCreate

Created pod: e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

openshift-ingress

deployment-controller

e2e-inf-a-22dfc1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-22dfc1-openshift-default-79f4d66d95 from 0 to 1

openshift-ingress

multus

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-658b8c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-658b8c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-22dfc1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-22dfc1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-22dfc1-6dccdddb7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-22dfc1: serviceaccount "payload-processing-e2e-inf-a-22dfc1" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-22dfc1: serviceaccount "payload-processing-e2e-inf-a-22dfc1" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf

AddedInterface

Add eth0 [10.132.1.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-658b8c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-658b8c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-inf-b-0b0610-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-0b0610-openshift-default-6df9db6447 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-0b0610

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-0b0610

openshift-ingress

replicaset-controller

e2e-inf-b-0b0610-openshift-default-6df9db6447

SuccessfulCreate

Created pod: e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

openshift-ingress

multus

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-0b0610

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0b0610: serviceaccount "payload-processing-e2e-inf-b-0b0610" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-0b0610

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-0b0610-667ff7d47c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0b0610-667ff7d47c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-0b0610-667ff7d47c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0b0610: serviceaccount "payload-processing-e2e-inf-b-0b0610" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0b0610-667ff7d47c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4
(x21)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Unhealthy

Readiness probe failed: Get "https://10.132.0.49:8000/ready": context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pn4zd

Unhealthy

Readiness probe failed: Get "https://10.132.0.47:8000/ready": context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf

Unhealthy

Readiness probe failed: timeout: health rpc did not complete within 1s

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4

AddedInterface

Add eth0 [10.132.1.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-lllgh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-bdmgw

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 4 to 3

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-r86lm

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-inf-a-50b3a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-50b3a6-openshift-default-77b64b67fc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-50b3a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-50b3a6

openshift-ingress

replicaset-controller

e2e-inf-a-50b3a6-openshift-default-77b64b67fc

SuccessfulCreate

Created pod: e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

openshift-ingress

multus

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

AddedInterface

Add eth0 [10.133.1.34/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-50b3a6: serviceaccount "payload-processing-e2e-inf-a-50b3a6" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-50b3a6-58d74c4dc5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-50b3a6: serviceaccount "payload-processing-e2e-inf-a-50b3a6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-50b3a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-50b3a6-58d74c4dc5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-50b3a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-50b3a6-58d74c4dc5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-msbsh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s

AddedInterface

Add eth0 [10.132.1.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-msbsh

AddedInterface

Add eth0 [10.133.1.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-msbsh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-msbsh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-msbsh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

openshift-ingress

deployment-controller

e2e-inf-b-63be7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-63be7a-openshift-default-867d7d59df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-63be7a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-63be7a

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

AddedInterface

Add eth0 [10.132.1.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

Unhealthy

Readiness probe failed: Get "http://10.134.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

ProbeError

Readiness probe error: Get "http://10.134.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-0b0610-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-0b0610-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

Unhealthy

Readiness probe failed: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

ProbeError

Readiness probe error: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-63be7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-63be7a: serviceaccount "payload-processing-e2e-inf-b-63be7a" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-63be7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-63be7a-d66cc7bff from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-63be7a-d66cc7bff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-63be7a-d66cc7bff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-63be7a: serviceaccount "payload-processing-e2e-inf-b-63be7a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-63be7a-d66cc7bff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-63be7a-d66cc7bff-s8ggk

openshift-ingress

kubelet

payload-processing-e2e-inf-b-63be7a-d66cc7bff-s8ggk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-63be7a-d66cc7bff-s8ggk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-63be7a-d66cc7bff-s8ggk

AddedInterface

Add eth0 [10.132.1.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-63be7a-d66cc7bff-s8ggk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp

AddedInterface

Add eth0 [10.132.1.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22dfc1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22dfc1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-50b3a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-50b3a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-312f21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-312f21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22dfc1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22dfc1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-312f21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-312f21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-inf-b-06644b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-06644b-openshift-default-f5fcd9d8f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-06644b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-06644b

openshift-ingress

replicaset-controller

e2e-inf-b-06644b-openshift-default-f5fcd9d8f

SuccessfulCreate

Created pod: e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

openshift-ingress

multus

e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-06644b: serviceaccount "payload-processing-e2e-inf-b-06644b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-06644b-5776d95ff9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-06644b-5776d95ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-06644b: serviceaccount "payload-processing-e2e-inf-b-06644b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-06644b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-06644b-5776d95ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-06644b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-06644b-5776d95ff9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-06644b-5776d95ff9-zp5tw

openshift-ingress

kubelet

payload-processing-e2e-inf-b-06644b-5776d95ff9-zp5tw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-06644b-5776d95ff9-zp5tw

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-06644b-5776d95ff9-zp5tw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-06644b-5776d95ff9-zp5tw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

ProbeError

Startup probe error: Get "http://10.133.1.34:15021/healthz/ready": dial tcp 10.133.1.34:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

Unhealthy

Startup probe failed: Get "http://10.133.1.34:15021/healthz/ready": dial tcp 10.133.1.34:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-06644b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-06644b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-50b3a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-50b3a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

Unhealthy

Readiness probe failed: Get "http://10.134.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

ProbeError

Readiness probe error: Get "http://10.134.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

Unhealthy

Startup probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

ProbeError

Startup probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-312f21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-312f21-openshift-default-69765ddd69 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-312f21-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-a-312f21-openshift-default-69765ddd69

SuccessfulCreate

Created pod: e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr
(x2)

openshift-ingress

kubelet

e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

openshift-ingress

deployment-controller

e2e-inf-b-63be7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-63be7a-openshift-default-867d7d59df from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-63be7a-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-0b0610-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-0b0610-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

Unhealthy

Readiness probe failed: Get "http://10.132.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

ProbeError

Readiness probe error: Get "http://10.132.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

ProbeError

Startup probe error: Get "http://10.132.1.54:15021/healthz/ready": dial tcp 10.132.1.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

Unhealthy

Startup probe failed: Get "http://10.132.1.54:15021/healthz/ready": dial tcp 10.132.1.54:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-06644b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-06644b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-63be7a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-63be7a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-inf-a-2966e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2966e7-openshift-default-57b4d978b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2966e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2966e7

openshift-ingress

replicaset-controller

e2e-inf-a-2966e7-openshift-default-57b4d978b9

SuccessfulCreate

Created pod: e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-63be7a-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

openshift-ingress

deployment-controller

e2e-inf-b-63be7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-63be7a-openshift-default-867d7d59df from 4 to 8

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-63be7a-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

(combined from similar events): Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

openshift-ingress

replicaset-controller

e2e-inf-b-63be7a-openshift-default-867d7d59df

SuccessfulCreate

Created pod: e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

openshift-ingress

deployment-controller

e2e-inf-b-63be7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-63be7a-openshift-default-867d7d59df from 8 to 10

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78383f-8559948df9-nj4tx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78383f-56d4ff85c9-g5k75

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

AddedInterface

Add eth0 [10.132.1.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

ProbeError

Startup probe error: Get "http://10.132.1.62:15021/healthz/ready": dial tcp 10.132.1.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

Unhealthy

Startup probe failed: Get "http://10.132.1.62:15021/healthz/ready": dial tcp 10.132.1.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-78383f-openshift-default-5797f74797-kxhf8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

AddedInterface

Add eth0 [10.133.1.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

Unhealthy

Startup probe failed: Get "http://10.133.1.41:15021/healthz/ready": dial tcp 10.133.1.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

ProbeError

Startup probe error: Get "http://10.133.1.41:15021/healthz/ready": dial tcp 10.133.1.41:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-50b3a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-50b3a6-openshift-default-77b64b67fc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-50b3a6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-a-50b3a6-openshift-default-77b64b67fc

SuccessfulCreate

Created pod: e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

openshift-ingress

multus

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

AddedInterface

Add eth0 [10.133.1.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-pvs6q

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-bee8f6-openshift-default-58f76f6545

SuccessfulDelete

Deleted pod: e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-bx7wv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-h8bt5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 3 to 2

openshift-ingress

deployment-controller

e2e-extmod-b-bee8f6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-bee8f6-openshift-default-58f76f6545 from 5 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bee8f6-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-658b8c-8f4c6c479-tjqpr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-extmod-b-bee8f6-openshift-default-58f76f6545

SuccessfulDelete

Deleted pod: e2e-extmod-b-bee8f6-openshift-default-58f76f6545-4gtzm
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-658b8c-6c7cdc8cf5-lbdsr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

Unhealthy

Startup probe failed: Get "http://10.133.1.42:15021/healthz/ready": dial tcp 10.133.1.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

ProbeError

Startup probe error: Get "http://10.133.1.42:15021/healthz/ready": dial tcp 10.133.1.42:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-ltw25

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-hkjcw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

AddedInterface

Add eth0 [10.133.1.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

Created

Container created

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

AddedInterface

Add eth0 [10.132.1.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

Started

Container started

openshift-ingress

multus

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

AddedInterface

Add eth0 [10.132.1.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-658b8c-openshift-default-777bdf6b85-srgrl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

AddedInterface

Add eth0 [10.133.1.44/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

AddedInterface

Add eth0 [10.132.1.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-b1a788-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-b1a788-openshift-default-f86c5f547 from 3 to 2

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

Created

Container created

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

AddedInterface

Add eth0 [10.132.1.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w3-a37cf0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a37cf0-openshift-default-d9d86696c from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a37cf0-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-a37cf0-openshift-default-d9d86696c

SuccessfulDelete

Deleted pod: e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

AddedInterface

Add eth0 [10.133.1.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2966e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2966e7-6d8c7c698c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2966e7-6d8c7c698c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2966e7-6d8c7c698c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2966e7: serviceaccount "payload-processing-e2e-inf-a-2966e7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2966e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2966e7: serviceaccount "payload-processing-e2e-inf-a-2966e7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2966e7-6d8c7c698c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulDelete

Deleted pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-n27fx

openshift-ingress

multus

payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-5ec436-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-5ec436-openshift-default-58bbc5478f from 6 to 4

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulDelete

Deleted pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-xdzp8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd

AddedInterface

Add eth0 [10.133.1.46/23] from ovn-kubernetes
(x35)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Unhealthy

Readiness probe failed: Get "https://10.132.0.49:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b97c6-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x8)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

Unhealthy

Startup probe failed: Get "http://10.133.1.43:15021/healthz/ready": dial tcp 10.133.1.43:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

Unhealthy

Readiness probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-pk7vg

ProbeError

Readiness probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-4b97c6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-4b97c6-openshift-default-bc5d59c59 from 3 to 2

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

ProbeError

Startup probe error: Get "http://10.133.1.43:15021/healthz/ready": dial tcp 10.133.1.43:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

ProbeError

Startup probe error: Get "http://10.133.1.44:15021/healthz/ready": dial tcp 10.133.1.44:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-msm5t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

Unhealthy

Startup probe failed: Get "http://10.133.1.44:15021/healthz/ready": dial tcp 10.133.1.44:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-65c448b547 from 10 to 7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-vbrfc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-vbrfc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-msm5t

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-d7499

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-5lphd

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

AddedInterface

Add eth0 [10.133.1.47/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

Unhealthy

Startup probe failed: Get "http://10.132.1.65:15021/healthz/ready": dial tcp 10.132.1.65:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

ProbeError

Startup probe error: Get "http://10.132.1.65:15021/healthz/ready": dial tcp 10.132.1.65:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

Unhealthy

Startup probe failed: Get "http://10.132.1.68:15021/healthz/ready": dial tcp 10.132.1.68:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

ProbeError

Startup probe error: Get "http://10.132.1.68:15021/healthz/ready": dial tcp 10.132.1.68:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-w2m76

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

ProbeError

Startup probe error: Get "http://10.133.1.45:15021/healthz/ready": dial tcp 10.133.1.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

Unhealthy

Startup probe failed: Get "http://10.133.1.45:15021/healthz/ready": dial tcp 10.133.1.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-42d786-openshift-default-776544c777

SuccessfulDelete

Deleted pod: e2e-extmod-a-42d786-openshift-default-776544c777-x7ff8
(x10)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

Unhealthy

Startup probe failed: Get "http://10.132.1.67:15021/healthz/ready": dial tcp 10.132.1.67:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

ProbeError

Startup probe error: Get "http://10.132.1.67:15021/healthz/ready": dial tcp 10.132.1.67:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-dwtbd

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-97z24

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-42d786-openshift-default-776544c777

SuccessfulDelete

Deleted pod: e2e-extmod-a-42d786-openshift-default-776544c777-97z24

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-57d2x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-extmod-a-42d786-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-42d786-openshift-default-776544c777 from 4 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-42d786-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-5lphd

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

Unhealthy

Startup probe failed: Get "http://10.132.1.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

ProbeError

Startup probe error: Get "http://10.132.1.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

Unhealthy

Startup probe failed: Get "http://10.133.1.47:15021/healthz/ready": dial tcp 10.133.1.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

ProbeError

Startup probe error: Get "http://10.133.1.47:15021/healthz/ready": dial tcp 10.133.1.47:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-5465q

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-8cvmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-312f21-openshift-default-69765ddd69-sr5cz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-312f21-56cc99d475-qtdtr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-312f21-6984dd475-rgnpn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0b0610-7d957d5bb7-thwqr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0b0610-667ff7d47c-hq2z4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-0b0610-openshift-default-6df9db6447-pdd2k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-cc0b41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-cc0b41

openshift-ingress

deployment-controller

e2e-inf-b-cc0b41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-cc0b41-openshift-default-6d5d745895 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-cc0b41-openshift-default-6d5d745895

SuccessfulCreate

Created pod: e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

openshift-ingress

multus

e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

AddedInterface

Add eth0 [10.132.1.71/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-cc0b41: serviceaccount "payload-processing-e2e-inf-b-cc0b41" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-cc0b41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-cc0b41: serviceaccount "payload-processing-e2e-inf-b-cc0b41" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-cc0b41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-gfrgb

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-86f5f0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-gfrgb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w2-86f5f0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857 from 2 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl

AddedInterface

Add eth0 [10.133.1.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857

SuccessfulDelete

Deleted pod: e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

openshift-ingress

multus

payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-gfrgb

AddedInterface

Add eth0 [10.133.1.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-gfrgb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-gfrgb

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-89qtj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22dfc1-6dccdddb7c-bhgtf

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-wgjhv

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-65c448b547 from 7 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-b6kzh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-xsg9n

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wgjhv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wgjhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b6kzh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-xsg9n

AddedInterface

Add eth0 [10.133.1.52/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b6kzh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xsg9n

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b6kzh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xsg9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wgjhv

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-b6kzh

AddedInterface

Add eth0 [10.132.1.72/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xsg9n

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-wgjhv

AddedInterface

Add eth0 [10.133.1.51/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xsg9n

Unhealthy

Startup probe failed: Get "http://10.133.1.52:15021/healthz/ready": dial tcp 10.133.1.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wgjhv

ProbeError

Startup probe error: Get "http://10.133.1.51:15021/healthz/ready": dial tcp 10.133.1.51:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wgjhv

Unhealthy

Startup probe failed: Get "http://10.133.1.51:15021/healthz/ready": dial tcp 10.133.1.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xsg9n

ProbeError

Startup probe error: Get "http://10.133.1.52:15021/healthz/ready": dial tcp 10.133.1.52:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b6kzh

Unhealthy

Startup probe failed: Get "http://10.132.1.72:15021/healthz/ready": dial tcp 10.132.1.72:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b6kzh

ProbeError

Startup probe error: Get "http://10.132.1.72:15021/healthz/ready": dial tcp 10.132.1.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

ProbeError

Readiness probe error: Get "http://10.132.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

Unhealthy

Readiness probe failed: Get "http://10.132.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22dfc1-64f75878b7-6bhw5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

Unhealthy

Startup probe failed: Get "http://10.132.1.66:15021/healthz/ready": dial tcp 10.132.1.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

ProbeError

Startup probe error: Get "http://10.132.1.66:15021/healthz/ready": dial tcp 10.132.1.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-22dfc1-openshift-default-79f4d66d95-xw79b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-63be7a-d66cc7bff-s8ggk

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-extmod-b-bee8f6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-bee8f6-openshift-default-58f76f6545 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bee8f6-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-bee8f6-openshift-default-58f76f6545

SuccessfulDelete

Deleted pod: e2e-extmod-b-bee8f6-openshift-default-58f76f6545-fx2zw
(x12)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2966e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulDelete

Deleted pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-26mbm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-5ec436-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-5ec436-openshift-default-58bbc5478f from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-kv89z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-4pnw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-2vgtj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-45b84

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vkmf9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-63be7a-55c7d654f9-h6xnp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-gfzb5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-n6bsx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-pm5vg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-tjpc8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-63be7a-openshift-default-867d7d59df-vqrkp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x13)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2966e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

ProbeError

Startup probe error: Get "http://10.132.1.71:15021/healthz/ready": dial tcp 10.132.1.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

Unhealthy

Startup probe failed: Get "http://10.132.1.71:15021/healthz/ready": dial tcp 10.132.1.71:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-cc0b41-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-cc0b41-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-rcvxl

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 3 to 2

openshift-ingress

gateway_labeler_controller

e2e-mt-8a098971

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8a098971

openshift-ingress

replicaset-controller

e2e-mt-8a098971-openshift-default-6bb9f7f49

SuccessfulCreate

Created pod: e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

openshift-ingress

deployment-controller

e2e-mt-8a098971-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8a098971-openshift-default-6bb9f7f49 from 0 to 1

openshift-ingress

multus

e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

AddedInterface

Add eth0 [10.132.1.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8a098971-569568574f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8a098971-569568574f-d27dl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8a098971

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8a098971-57dd9c6d75 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8a098971-57dd9c6d75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8a098971: serviceaccount "payload-processing-e2e-mt-8a098971" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8a098971-569568574f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8a098971-569568574f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8a098971: serviceaccount "payload-processing-e2e-mt-8a098971" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8a098971

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8a098971-569568574f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8a098971-57dd9c6d75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-566nd

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-566nd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-566nd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-8a098971-569568574f-d27dl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-8a098971-569568574f-d27dl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-8a098971-569568574f-d27dl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-8a098971-569568574f-d27dl

AddedInterface

Add eth0 [10.132.1.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-566nd

AddedInterface

Add eth0 [10.132.1.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-566nd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-50b3a6-58d74c4dc5-msbsh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

Started

Container started

openshift-ingress

deployment-controller

e2e-inf-a-2966e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2966e7-openshift-default-57b4d978b9 from 1 to 2

openshift-ingress

multus

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-a-2966e7-openshift-default-57b4d978b9

SuccessfulCreate

Created pod: e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2966e7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-wznbr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-50b3a6-openshift-default-77b64b67fc-6k9cw

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-06644b-5776d95ff9-zp5tw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-50b3a6-cf79d6cf-w785s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-06644b-openshift-default-f5fcd9d8f-x4zmj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-06644b-7c6db78bb7-bcxb7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

ProbeError

Startup probe error: Get "http://10.132.1.78:15021/healthz/ready": dial tcp 10.132.1.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

Unhealthy

Startup probe failed: Get "http://10.132.1.78:15021/healthz/ready": dial tcp 10.132.1.78:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-8a098971-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-8a098971-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

deployment-controller

e2e-worker-w1-24cfb6-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-24cfb6-openshift-default-59b8747df from 3 to 2
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w1-24cfb6-openshift-default-59b8747df

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-29j78

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-24cfb6-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-5ec436-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-5ec436-openshift-default-58bbc5478f from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-5ec436-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-5ec436-openshift-default-58bbc5478f

SuccessfulDelete

Deleted pod: e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-kp2hn

Killing

Stopping container istio-proxy
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-547hk

Unhealthy

Liveness probe failed: Get "https://10.132.0.49:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-8a098971-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-8a098971-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-a-w0-1e2281-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-1e2281-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c

SuccessfulCreate

Created pod: e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

AddedInterface

Add eth0 [10.133.1.56/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-tw9kl

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tw9kl

Killing

Stopping container discovery
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

Unhealthy

Startup probe failed: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

ProbeError

Startup probe error: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-8a098971-569568574f-d27dl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8a098971-57dd9c6d75-566nd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-8a098971-openshift-default-6bb9f7f49-nzq68

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-66eed1-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x5)

openshift-ingress

deployment-controller

e2e-worker-w2-66eed1-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-z6bsz

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-r67jw

openshift-ingress

deployment-controller

e2e-shared-a-w1-b6b6f4-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b6b6f4-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-8bvl5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-w5nzl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-2966e7-openshift-default-57b4d978b9-rg7hl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2966e7-6d8c7c698c-jgf2m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2966e7-c4477dcd7-jq4qd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cc0b41-79dd8fbb7c-gfrgb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-807c08-64d48fd4f9-xh75b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-807c08-56f5765679-h2lww

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-807c08-openshift-default-56bd9457-mp8xh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bee8f6-c879f6577-9l726

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cc0b41-d965d7fc5-qxkzl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-cc0b41-openshift-default-6d5d745895-s74xm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bee8f6-74cc6bdfc5-7q79z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lwtbj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-bee8f6-openshift-default-58f76f6545-lndg2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b1a788-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w2-b1a788-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-b1a788-openshift-default-f86c5f547 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-x9mch

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b6b6f4-85c49d9b75-6szp7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b6b6f4-74548ccbd7-hflxn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-9c6bc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-42d786-openshift-default-776544c777-j7jzz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-42d786-77876d7c85-sxz59

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-42d786-cfc454fff-25p7k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-b6b6f4-openshift-default-786ffdb75c-vwn2r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-327608-openshift-default-569bd4db89-gqhl9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-2961d5-openshift-default-76d5b87c4f-l75rl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c

SuccessfulCreate

Created pod: e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-7771bf-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w0-7771bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-7771bf-openshift-default-b8d97467c from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

Started

Container started

openshift-ingress

multus

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

AddedInterface

Add eth0 [10.133.1.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-327608-895868c7f-7m2kh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-327608-64955f5f6f-t8d27

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0f0baf-5d5c9694d7-nr6nl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0f0baf-6f5bcfbd89-d2zdm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

Unhealthy

Startup probe failed: Get "http://10.133.1.57:15021/healthz/ready": dial tcp 10.133.1.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

ProbeError

Startup probe error: Get "http://10.133.1.57:15021/healthz/ready": dial tcp 10.133.1.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2961d5-98554786c-b5hmm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2961d5-6b6f67c495-5kbn4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-0f0baf-openshift-default-66f587fff5-md698

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a8e574-bfb58f65f-ktqdx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a8e574-6866d758c-kfjgr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-72f605-6c67b54799-z6lxr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-72f605-6bcd6bc985-gnbw6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-a8e574-openshift-default-658b84d485-kht8g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-24cfb6-696bd96559-qjk8f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-24cfb6-647b74bd55-ntqth

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-72f605-openshift-default-5bd6c4dc87-jzmwn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-5c3c1f-openshift-default-68b7fcf5d9-9nb2c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-86f5f0-7446f48bdc-57npd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-86f5f0-6f7f46dccf-rqnxf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-bzb55

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-24cfb6-openshift-default-59b8747df-dpdsd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5c3c1f-df9774475-2kz8w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5c3c1f-7d6c46555-dww8v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-86f5f0-openshift-default-6c8789d857-9mzg7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a37cf0-fd9d757c9-6dfrk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

Unhealthy

Readiness probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-b1a788-openshift-default-f86c5f547-rdkcw

ProbeError

Readiness probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a37cf0-64c6d9bc7-k9mzg

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.52:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b1a788-7f8b8cbf-vhr5v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-pcbf7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b1a788-5fb65846f9-dhh27

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-a37cf0-openshift-default-d9d86696c-tv9qn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-47e1c2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc

SuccessfulCreate

Created pod: e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

openshift-ingress

deployment-controller

e2e-shared-a-w4-47e1c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-47e1c2-openshift-default-77968876dc from 1 to 2

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

Created

Container created

openshift-ingress

multus

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

ProbeError

Startup probe error: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

Unhealthy

Startup probe failed: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-66eed1-68445545c7-hndg6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-66eed1-54f947d84c-r4b97

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-qnsxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-66eed1-openshift-default-6dbfdfb4f5-kfbd7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-65c448b547 from 10 to 9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-b6kzh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-b6kzh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-wgjhv
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-65c448b547 from 9 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wgjhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7350-25a722

AddedInterface

Add eth0 [10.133.1.64/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7350-25a722

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7350-25a722

Created

Container created

opendatahub

kubelet

test-curl-7350-25a722

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

test-curl-7350-2ca161

AddedInterface

Add eth0 [10.133.1.65/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7350-25a722

Killing

Stopping container test-curl-7350-25a722

opendatahub

kubelet

test-curl-7350-2ca161

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-36a991-openshift-default-66bfb884c7-h2c9k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-7350-2ca161

Created

Container created

opendatahub

kubelet

test-curl-7350-2ca161

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-7350-2ca161

Killing

Stopping container test-curl-7350-2ca161

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-36a991-7d5bf9cbc-kmq5r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-36a991-9dfd66d49-xtk6j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-2db162-openshift-default-56b7cbc657-pw6qh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5

SuccessfulCreate

Created pod: e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-9165c3-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm

AddedInterface

Add eth0 [10.132.1.110/23] from ovn-kubernetes
(x3)

openshift-ingress

deployment-controller

e2e-shared-b-w4-9165c3-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5 from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2db162-75bf5bd459-hqrzv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2db162-5776877f-nrsjw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm

ProbeError

Startup probe error: Get "http://10.132.1.110:15021/healthz/ready": dial tcp 10.132.1.110:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm

Unhealthy

Startup probe failed: Get "http://10.132.1.110:15021/healthz/ready": dial tcp 10.132.1.110:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-rt2c2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-2qhql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-1e2281-openshift-default-5b4778f47c-qjfgp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-sxhh7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-1e2281-5cb6cf9947-gb8bg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-1e2281-5dd5754475-vxpkc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-7771bf-openshift-default-b8d97467c-x7hb2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7771bf-76f4975979-4xbjq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-4n9pv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7771bf-5948cf8455-qtf55

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.183:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-extmod-a-5ec436-openshift-default-58bbc5478f-tlv57

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-5ec436-cd8fd9675-splvc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-5ec436-9fc7c8ccf-xtql7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-1ef96f-openshift-default-5995666b49-ccw89

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1ef96f-6b4f5f9ff9-68w5t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1ef96f-776b648c8c-8z56d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-5p2hz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4b97c6-openshift-default-bc5d59c59-pt87h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b97c6-74f55b5f69-f9kwh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b97c6-67955696c5-wfzv9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-7tsmq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-47e1c2-openshift-default-77968876dc-ljkzn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-pcknm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-9165c3-openshift-default-79758b8bf5-9v6sr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-47e1c2-84f6cb4947-lgbqt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-47e1c2-84945f99d9-pslvv

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.166:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-9165c3-7ccd478485-thjx9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-bktgf

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bktgf

Killing

Stopping container discovery
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-9165c3-74885664f5-wvkn2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-worker-w4-77f103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-77f103-openshift-default-9886c5d7c from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-77f103-openshift-default-9886c5d7c

SuccessfulCreate

Created pod: e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-77f103-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

Unhealthy

Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

ProbeError

Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

ProbeError

Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

Unhealthy

Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-77f103-6d75f74b87-96cvl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-77f103-5b4b55b64c-j8tj8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-4j6lw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-dj6t2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-77f103-openshift-default-9886c5d7c-mzlwl

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-mdxxk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-65c448b547 from 8 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-cmqs4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-65c448b547-mdxxk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-cmqs4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-f8e1abfd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f8e1abfd

openshift-ingress

replicaset-controller

e2e-ait-f8e1abfd-openshift-default-779df9d59f

SuccessfulCreate

Created pod: e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

openshift-ingress

deployment-controller

e2e-ait-f8e1abfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f8e1abfd-openshift-default-779df9d59f from 0 to 1

openshift-ingress

multus

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

AddedInterface

Add eth0 [10.133.1.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f8e1abfd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f8e1abfd-677b84899c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f8e1abfd: serviceaccount "payload-processing-e2e-ait-f8e1abfd" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f8e1abfd-677b84899c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f8e1abfd-677b84899c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f8e1abfd: serviceaccount "payload-processing-e2e-ait-f8e1abfd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f8e1abfd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-f7sqw

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f8e1abfd-677b84899c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f8e1abfd-677b84899c-xcjjk

openshift-ingress

multus

payload-processing-e2e-ait-f8e1abfd-677b84899c-xcjjk

AddedInterface

Add eth0 [10.132.1.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-f7sqw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-f7sqw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-f7sqw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-f7sqw

AddedInterface

Add eth0 [10.133.1.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f8e1abfd-677b84899c-xcjjk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-f8e1abfd-677b84899c-xcjjk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-f8e1abfd-677b84899c-xcjjk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

Unhealthy

Startup probe failed: Get "http://10.133.1.66:15021/healthz/ready": dial tcp 10.133.1.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

ProbeError

Startup probe error: Get "http://10.133.1.66:15021/healthz/ready": dial tcp 10.133.1.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8e1abfd-5d48457bf5-f7sqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f8e1abfd-677b84899c-xcjjk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f8e1abfd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f8e1abfd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

Killing

Stopping container istio-proxy

opendatahub

kubelet

maas-controller-56bc685b8f-572rh

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-56bc685b8f

SuccessfulDelete

Deleted pod: maas-controller-56bc685b8f-572rh

openshift-ingress

kubelet

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-f8e1abfd-openshift-default-779df9d59f-bq2gh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

multus

maas-controller-56bc685b8f-jx88t

AddedInterface

Add eth0 [10.133.1.69/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-56bc685b8f

SuccessfulCreate

Created pod: maas-controller-56bc685b8f-jx88t

opendatahub

kubelet

maas-controller-56bc685b8f-jx88t

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:1142174a4a10b8249aec3b3ffe7b075d5e2c896c81dfdc9736ba22300ff17853"

opendatahub

kubelet

maas-controller-56bc685b8f-jx88t

Started

Container started

opendatahub

kubelet

maas-controller-56bc685b8f-jx88t

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:1142174a4a10b8249aec3b3ffe7b075d5e2c896c81dfdc9736ba22300ff17853" in 2.045s (2.045s including waiting). Image size: 200094710 bytes.

opendatahub

kubelet

maas-controller-56bc685b8f-jx88t

Created

Container created
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-65c448b547 from 6 to 10
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-kgx7c

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-zws9j

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-th4lt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-65c448b547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-65c448b547-r2rbg

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-zws9j

AddedInterface

Add eth0 [10.132.1.119/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-kgx7c

AddedInterface

Add eth0 [10.133.1.71/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-th4lt

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-65c448b547-r2rbg

AddedInterface

Add eth0 [10.133.1.70/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

maas-controller-56bc685b8f-jx88t_ab91917d-3617-4e2c-8275-5a717ed6a6ed

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-56bc685b8f-jx88t_ab91917d-3617-4e2c-8275-5a717ed6a6ed became leader
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

ProbeError

Startup probe error: Get "http://10.133.1.70:15021/healthz/ready": dial tcp 10.133.1.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

Unhealthy

Startup probe failed: Get "http://10.133.1.70:15021/healthz/ready": dial tcp 10.133.1.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

Unhealthy

Startup probe failed: Get "http://10.132.1.119:15021/healthz/ready": dial tcp 10.132.1.119:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

ProbeError

Startup probe error: Get "http://10.132.1.119:15021/healthz/ready": dial tcp 10.132.1.119:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

ProbeError

Startup probe error: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

Unhealthy

Startup probe failed: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

ProbeError

Startup probe error: Get "http://10.133.1.71:15021/healthz/ready": dial tcp 10.133.1.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

Unhealthy

Startup probe failed: Get "http://10.133.1.71:15021/healthz/ready": dial tcp 10.133.1.71:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

Unhealthy

Startup probe failed: Get "http://10.132.1.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

Unhealthy

Startup probe failed: Get "http://10.134.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

ProbeError

Startup probe error: Get "http://10.133.1.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

Unhealthy

Startup probe failed: Get "http://10.133.1.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

ProbeError

Startup probe error: Get "http://10.134.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

ProbeError

Startup probe error: Get "http://10.132.1.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

Unhealthy

Startup probe failed: Get "http://10.133.1.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

ProbeError

Startup probe error: Get "http://10.133.1.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

maas-controller-56bc685b8f-jx88t

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-56bc685b8f

SuccessfulDelete

Deleted pod: maas-controller-56bc685b8f-jx88t
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-56bc685b8f from 1 to 0
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-56bc685b8f from 0 to 1

opendatahub

replicaset-controller

maas-controller-56bc685b8f

SuccessfulCreate

Created pod: maas-controller-56bc685b8f-tzvbj

opendatahub

kubelet

maas-controller-56bc685b8f-tzvbj

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:1142174a4a10b8249aec3b3ffe7b075d5e2c896c81dfdc9736ba22300ff17853"

opendatahub

multus

maas-controller-56bc685b8f-tzvbj

AddedInterface

Add eth0 [10.133.1.72/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-56bc685b8f-tzvbj

Started

Container started

opendatahub

kubelet

maas-controller-56bc685b8f-tzvbj

Created

Container created

opendatahub

kubelet

maas-controller-56bc685b8f-tzvbj

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:1142174a4a10b8249aec3b3ffe7b075d5e2c896c81dfdc9736ba22300ff17853" in 436ms (436ms including waiting). Image size: 200094710 bytes.

opendatahub

maas-controller-56bc685b8f-tzvbj_c5f03392-9beb-4015-a749-0c6334767c2a

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-56bc685b8f-tzvbj_c5f03392-9beb-4015-a749-0c6334767c2a became leader
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

Unhealthy

Readiness probe failed: Get "http://10.134.0.22:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-wtks5

ProbeError

Readiness probe error: Get "http://10.134.0.22:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.Service llm/e2e-prio-pool-3c449aaf-epp-service

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-3c449aaf-epp-auth-rb

llm

deployment-controller

e2e-prio-pool-3c449aaf-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.Secret llm/e2e-prio-pool-3c449aaf-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.Deployment llm/e2e-prio-pool-3c449aaf-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.Service llm/e2e-prio-pool-3c449aaf-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.ServiceAccount llm/e2e-prio-pool-3c449aaf-epp-sa

llm

replicaset-controller

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55

SuccessfulCreate

Created pod: e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

llm

replicaset-controller

e2e-prio-pool-3c449aaf-kserve-b5dcbd876

SuccessfulCreate

Created pod: e2e-prio-pool-3c449aaf-kserve-b5dcbd876-v2lqp

llm

deployment-controller

e2e-prio-pool-3c449aaf-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-3c449aaf-kserve-b5dcbd876 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.Deployment llm/e2e-prio-pool-3c449aaf-kserve-router-scheduler

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.RoleBinding llm/e2e-prio-pool-3c449aaf-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

Created v1.Role llm/e2e-prio-pool-3c449aaf-epp-role

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-b5dcbd876-v2lqp

Started

Container started

llm

multus

e2e-prio-pool-3c449aaf-kserve-b5dcbd876-v2lqp

AddedInterface

Add eth0 [10.133.1.73/23] from ovn-kubernetes

llm

multus

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

AddedInterface

Add eth0 [10.132.1.125/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-b5dcbd876-v2lqp

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-b5dcbd876-v2lqp

Created

Container created

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-3c449aaf-kserve-route
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-3c449aaf-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

Created

Container created

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

Started

Container started

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 2.058s (2.058s including waiting). Image size: 184206420 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Updated

Updated v1.Secret llm/e2e-prio-pool-3c449aaf-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-3c449aaf] is Ready

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tlkmj

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-tlkmj

llm

LLMInferenceServiceController

e2e-prio-pool-3c449aaf

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-3c449aaf-epp-auth-rb

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-b5dcbd876-v2lqp

Killing

Stopping container main

openshift-ingress

multus

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

AddedInterface

Add eth0 [10.133.1.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9

SuccessfulCreate

Created pod: e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

openshift-ingress

deployment-controller

e2e-worker-single-main-c3df6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-c3df6f-openshift-default-d595c96b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-c3df6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-c3df6f

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-c3df6f-69769776cf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65cfcbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-c3df6f-85d65cfcbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-c3df6f: serviceaccount "payload-processing-e2e-worker-single-main-c3df6f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-c3df6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-c3df6f-69769776cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65cfcbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-c3df6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-c3df6f-85d65cfcbc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-c3df6f-69769776cf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-c3df6f-69769776cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-c3df6f: serviceaccount "payload-processing-e2e-worker-single-main-c3df6f" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj

AddedInterface

Add eth0 [10.133.1.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8

AddedInterface

Add eth0 [10.133.1.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

Unhealthy

Startup probe failed: Get "http://10.133.1.74:15021/healthz/ready": dial tcp 10.133.1.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

ProbeError

Startup probe error: Get "http://10.133.1.74:15021/healthz/ready": dial tcp 10.133.1.74:15021: connect: connection refused body:
(x5)

llm

kubelet

e2e-prio-pool-3c449aaf-kserve-router-scheduler-6f848d6b55-2nlzc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-c3df6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-c3df6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cchqcj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65slqq8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-c3df6f-69769776cf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-c3df6f-69769776cgjn78
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65cfcbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-c3df6f-85d65cfcbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-c3df6f: serviceaccount "payload-processing-e2e-worker-single-main-c3df6f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-c3df6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-c3df6f-85d65cfcbc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-c3df6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-c3df6f-69769776cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65cfcbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-c3df6f-85d65djbrl
(x3)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-c3df6f-69769776cf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-c3df6f-69769776cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-c3df6f: serviceaccount "payload-processing-e2e-worker-single-main-c3df6f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65djbrl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-c3df6f-69769776cgjn78

AddedInterface

Add eth0 [10.133.1.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cgjn78

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cgjn78

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cgjn78

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65djbrl

AddedInterface

Add eth0 [10.133.1.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65djbrl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65djbrl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-c3df6f-69769776cgjn78

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-c3df6f-85d65djbrl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-c3df6f-openshift-default-d595c96b9-ztstb

Killing

Stopping container istio-proxy

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Created

Created v1.PodMonitor llm/e2e-same-id-a-c03c63e2-kserve-llmisvc-engine-default

llm

kubelet

e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Created

Created v1.PodMonitor llm/e2e-same-id-a-c03c63e2-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Created

Created v1.Deployment llm/e2e-same-id-a-c03c63e2-kserve

llm

multus

e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7

AddedInterface

Add eth0 [10.133.1.82/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7

Created

Container created

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Created

Created v1.Secret llm/e2e-same-id-a-c03c63e2-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Created

Created v1.Service llm/e2e-same-id-a-c03c63e2-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-c03c63e2-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Created

Created v1.DestinationRule llm/e2e-same-id-a-c03c63e2-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Created

Created v1.HTTPRoute llm/e2e-same-id-a-c03c63e2-kserve-route

llm

replicaset-controller

e2e-same-id-a-c03c63e2-kserve-7c45979757

SuccessfulCreate

Created pod: e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7

llm

deployment-controller

e2e-same-id-a-c03c63e2-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-c03c63e2-kserve-7c45979757 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

Updated

Updated v1.Secret llm/e2e-same-id-a-c03c63e2-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-c03c63e2] is Ready

llm

deployment-controller

e2e-same-id-b-c03c63e2-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-c03c63e2-kserve-6d5c95fc85 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Created

Created v1.DestinationRule llm/e2e-same-id-b-c03c63e2-kserve-workload-svc

llm

replicaset-controller

e2e-same-id-b-c03c63e2-kserve-6d5c95fc85

SuccessfulCreate

Created pod: e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Created

Created v1.Secret llm/e2e-same-id-b-c03c63e2-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-c03c63e2-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Created

Created v1.PodMonitor llm/e2e-same-id-b-c03c63e2-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Created

Created v1.PodMonitor llm/e2e-same-id-b-c03c63e2-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Created

Created v1.Deployment llm/e2e-same-id-b-c03c63e2-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Created

Created v1.HTTPRoute llm/e2e-same-id-b-c03c63e2-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Created

Created v1.Service llm/e2e-same-id-b-c03c63e2-kserve-workload-svc

llm

kubelet

e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq

Started

Container started

llm

kubelet

e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq

Created

Container created

llm

multus

e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq

AddedInterface

Add eth0 [10.133.1.83/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

Updated

Updated v1.Secret llm/e2e-same-id-b-c03c63e2-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-c03c63e2] is Ready
(x8)

llm

LLMInferenceServiceController

e2e-same-id-b-c03c63e2

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-c03c63e2 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-c03c63e2; safe to ignore if traffic splitting is planned
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-c03c63e2

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-c03c63e2 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-c03c63e2; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq

Killing

Stopping container main

llm

kubelet

e2e-same-id-a-c03c63e2-kserve-7c45979757-gflr7

Unhealthy

Readiness probe failed: Get "https://10.133.1.82:8000/ready": dial tcp 10.133.1.82:8000: connect: connection refused

llm

kubelet

e2e-same-id-b-c03c63e2-kserve-6d5c95fc85-cgsmq

Unhealthy

Readiness probe failed: Get "https://10.133.1.83:8000/ready": dial tcp 10.133.1.83:8000: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-99bb68447 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-99bb68447

SuccessfulCreate

Created pod: payload-pre-processing-99bb68447-w6bqc

openshift-ingress

multus

payload-pre-processing-99bb68447-w6bqc

AddedInterface

Add eth0 [10.133.1.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-99bb68447-w6bqc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-99bb68447-w6bqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-99bb68447-w6bqc

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-nnt4m

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-nnt4m

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-58b55f785c

SuccessfulCreate

Created pod: payload-processing-58b55f785c-rh8fz

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-58b55f785c from 0 to 1

openshift-ingress

kubelet

payload-processing-58b55f785c-rh8fz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-58b55f785c-rh8fz

Started

Container started

openshift-ingress

kubelet

payload-processing-58b55f785c-rh8fz

Created

Container created

openshift-ingress

multus

payload-processing-58b55f785c-rh8fz

AddedInterface

Add eth0 [10.133.1.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-5hb2w

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5hb2w

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

replicaset-controller

payload-pre-processing-7d54786449

SuccessfulCreate

Created pod: payload-pre-processing-7d54786449-dvg2t

openshift-ingress

replicaset-controller

payload-processing-fd758c546

SuccessfulCreate

Created pod: payload-processing-fd758c546-br2db

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-fd758c546 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7d54786449 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7d54786449-dvg2t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-7d54786449-dvg2t

Started

Container started

openshift-ingress

multus

payload-pre-processing-7d54786449-dvg2t

AddedInterface

Add eth0 [10.133.1.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-fd758c546-br2db

AddedInterface

Add eth0 [10.133.1.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-fd758c546-br2db

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-fd758c546-br2db

Created

Container created

openshift-ingress

kubelet

payload-processing-fd758c546-br2db

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7d54786449-dvg2t

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-99bb68447

SuccessfulDelete

Deleted pod: payload-pre-processing-99bb68447-w6bqc

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-99bb68447 from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-99bb68447-w6bqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-58b55f785c-rh8fz

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-58b55f785c from 1 to 0

openshift-ingress

replicaset-controller

payload-processing-58b55f785c

SuccessfulDelete

Deleted pod: payload-processing-58b55f785c-rh8fz

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-smhvg

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-smhvg

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-smhvg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5bcd7997-smhvg

AddedInterface

Add eth0 [10.133.1.88/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-smhvg

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-smhvg

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-single-main-3bd024-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-3bd024-openshift-default-d85b56ffc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-3bd024

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-3bd024

openshift-ingress

replicaset-controller

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc

SuccessfulCreate

Created pod: e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

openshift-ingress

multus

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

AddedInterface

Add eth0 [10.133.1.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-3bd024-7885d95947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-3bd024-7885d95947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-3bd024-7885d95947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-3bd024: serviceaccount "payload-processing-e2e-worker-single-main-3bd024" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-3bd024

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-3bd024-779dd77cc7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-3bd024-779dd77cc7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-3bd024-779dd77cc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-3bd024: serviceaccount "payload-processing-e2e-worker-single-main-3bd024" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-3bd024-779dd77cc7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-3bd024

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-3bd024-7885d95947 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s

AddedInterface

Add eth0 [10.133.1.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf

AddedInterface

Add eth0 [10.133.1.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

Unhealthy

Readiness probe failed: Get "http://10.133.1.89:15021/healthz/ready": dial tcp 10.133.1.89:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

ProbeError

Readiness probe error: Get "http://10.133.1.89:15021/healthz/ready": dial tcp 10.133.1.89:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

ProbeError

Startup probe error: Get "http://10.133.1.89:15021/healthz/ready": dial tcp 10.133.1.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

Unhealthy

Startup probe failed: Get "http://10.133.1.89:15021/healthz/ready": dial tcp 10.133.1.89:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-3bd024-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-3bd024-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885d7sx2s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccczvxf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-3bd024

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-3bd024-7885d95947 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-3bd024-7885d95947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-3bd024-7885d95947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-3bd024: serviceaccount "payload-processing-e2e-worker-single-main-3bd024" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-3bd024-7885d95947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-3bd024-7885dfkt9h
(x3)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-3bd024-779dd77cc7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-3bd024-779dd77cc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-3bd024: serviceaccount "payload-processing-e2e-worker-single-main-3bd024" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-3bd024

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-3bd024-779dd77cc7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-3bd024-779dd77cc7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-3bd024-779dd77ccrhgpb

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccrhgpb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885dfkt9h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885dfkt9h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885dfkt9h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-3bd024-7885dfkt9h

AddedInterface

Add eth0 [10.133.1.95/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-single-main-3bd024-779dd77ccrhgpb

AddedInterface

Add eth0 [10.133.1.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccrhgpb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccrhgpb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-3bd024-7885dfkt9h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-3bd024-779dd77ccrhgpb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-3bd024-openshift-default-d85b56ffc-tlfbd

Killing

Stopping container istio-proxy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f56vl

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-f56vl

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-8c4p4
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-8c4p4

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-8c4p4

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-8c4p4

AddedInterface

Add eth0 [10.132.1.149/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-8c4p4

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-8c4p4_6e935b1f-3d32-4a8c-9751-9bc03ef184da

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-8c4p4_6e935b1f-3d32-4a8c-9751-9bc03ef184da became leader
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-jv8f4

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-jv8f4

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xsg9n

Unhealthy

Readiness probe failed: Get "http://10.133.1.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xsg9n

ProbeError

Readiness probe error: Get "http://10.133.1.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xj2fs

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-xj2fs

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

Unhealthy

Readiness probe failed: Get "http://10.133.1.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

Unhealthy

Readiness probe failed: Get "http://10.133.1.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-r2rbg

ProbeError

Readiness probe error: Get "http://10.133.1.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

Unhealthy

Readiness probe failed: Get "http://10.132.1.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-kgx7c

ProbeError

Readiness probe error: Get "http://10.133.1.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-zws9j

ProbeError

Readiness probe error: Get "http://10.132.1.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

Unhealthy

Readiness probe failed: Get "http://10.134.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-th4lt

ProbeError

Readiness probe error: Get "http://10.134.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-dtrzt

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-dtrzt

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-fl8ch

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-65c448b547-fl8ch

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: