Time Namespace Component RelatedObject Reason Message

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-zndxf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-zndxf to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4 to ip-10-0-132-167.us-east-2.compute.internal

ai-tenants

e2e-autores-146318

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-146318: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-6f33a0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-6f33a0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-a62d22

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-a62d22: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-c47670

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-c47670: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-ded926

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-ded926: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-ef1693

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-ef1693: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-1a18c8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-1a18c8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-7c192b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-7c192b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-9f71f2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-9f71f2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-cf53a4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-cf53a4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-17adbf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-17adbf: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-db71f4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-db71f4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-d0441c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-d0441c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-4d1115

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-4d1115: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-1ec4b892

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-1ec4b892: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-7e439d04

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-7e439d04: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-a2ccd8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-a2ccd8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-b26c22

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-b26c22: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-8f8aa8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-8f8aa8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-a724a6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-a724a6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-9add72

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-9add72: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-2b8a08

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-2b8a08: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-a4ab8e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-a4ab8e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-08111b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-08111b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-e440bc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-e440bc: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-d3ca48

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-d3ca48: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-c381a7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-c381a7: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-2hskc

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-2hskc to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-8w2nb

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-8w2nb to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-5r75g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-5r75g to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-ef15d972-75849948ff-bz4sc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ef15d972-75849948ff-bz4sc to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-146318-bcd6dd8cf-mntvr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-146318-bcd6dd8cf-mntvr to ip-10-0-139-248.us-east-2.compute.internal

opendatahub

test-curl-7095-d9dfdd

Scheduled

Successfully assigned opendatahub/test-curl-7095-d9dfdd to ip-10-0-132-167.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-l28zx

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-l28zx to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-418af8-885c454d7-mkx76

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-418af8-885c454d7-mkx76 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-z55dw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-z55dw to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-jx5xc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-jx5xc to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-tbkh6

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-tbkh6 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-d969013e-85c7895599-g4z9h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d969013e-85c7895599-g4z9h to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-c87701ad-b469d86dc-4mcbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c87701ad-b469d86dc-4mcbq to ip-10-0-132-167.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-jwwdm

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-jwwdm to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

test-curl-7095-f2afce

Scheduled

Successfully assigned opendatahub/test-curl-7095-f2afce to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-021a5a5c-58589f959-92jwh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-021a5a5c-58589f959-92jwh to ip-10-0-131-36.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-2trjw

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-2trjw to ip-10-0-132-167.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5965948766-45jjk

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5965948766-45jjk to ip-10-0-139-248.us-east-2.compute.internal

opendatahub

ai-gateway-controller-6f5b4db54-wxw9w

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6f5b4db54-wxw9w to ip-10-0-131-36.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5965948766-cg76t

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5965948766-cg76t to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

ai-gateway-controller-5d8dddb676-vts47

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5d8dddb676-vts47 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts to ip-10-0-139-248.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5965948766-qhxm9

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5965948766-qhxm9 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-khw76

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-khw76 to ip-10-0-131-36.us-east-2.compute.internal

kuadrant-system

authorino-5588f885fc-qvxj7

Scheduled

Successfully assigned kuadrant-system/authorino-5588f885fc-qvxj7 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd to ip-10-0-132-167.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-nx2g7

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-nx2g7 to ip-10-0-131-36.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-fdc7999b7-xb26w

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-fdc7999b7-xb26w to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-74d765fb54-fcczn

Scheduled

Successfully assigned openshift-ingress/payload-processing-74d765fb54-fcczn to ip-10-0-131-36.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-bf6dd6dcc-gwprz

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-bf6dd6dcc-gwprz to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-776d6d99b-q7jqc

Scheduled

Successfully assigned openshift-ingress/payload-processing-776d6d99b-q7jqc to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-021a5a5c-859d56dfc9-6prfw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-021a5a5c-859d56dfc9-6prfw to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-c87701ad-6ccb48d5c7-hzscz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c87701ad-6ccb48d5c7-hzscz to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

Scheduled

Successfully assigned openshift-ingress/e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc to ip-10-0-139-248.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-8c92c

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-8c92c to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-d969013e-69795cd9c-fpcj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d969013e-69795cd9c-fpcj9 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-e04a4e0c-5645d65955-7g5s4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e04a4e0c-5645d65955-7g5s4 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-95hxq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-95hxq to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-418af8-55df5c84df-vjqhm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-418af8-55df5c84df-vjqhm to ip-10-0-131-36.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-877757f87-7znqp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-877757f87-7znqp to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-146318-7c785754ff-s472g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-146318-7c785754ff-s472g to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-ef15d972-6c89559d89-rrz7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ef15d972-6c89559d89-rrz7f to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-6f33a0-7fc4449fc5-rg4b4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-6f33a0-7fc4449fc5-rg4b4 to ip-10-0-139-248.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-p4bbv

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-p4bbv to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx to ip-10-0-131-36.us-east-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-rj2vw

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-rj2vw to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw to ip-10-0-132-167.us-east-2.compute.internal

kuadrant-system

authorino-796d65f566-65br2

Scheduled

Successfully assigned kuadrant-system/authorino-796d65f566-65br2 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b to ip-10-0-131-36.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-p5jpw

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-p5jpw to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh to ip-10-0-139-248.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-69d95d887d-zpbks

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-69d95d887d-zpbks to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-6xt6h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-6xt6h to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-9mxzh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-9mxzh to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg to ip-10-0-139-248.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-69d95d887d-xsbb2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-69d95d887d-xsbb2 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7b67449fb5mtj65

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7b67449fb5mtj65 to ip-10-0-139-248.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6958bdd4ff-zdwmx

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6958bdd4ff-zdwmx to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d0441c-5678568b5-zwjch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d0441c-5678568b5-zwjch to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6 to ip-10-0-132-167.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-t5l28

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-t5l28 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-4d1115-578bff4f88-fb7gg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-4d1115-578bff4f88-fb7gg to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-4d1115-8b4cdc999-vj6xh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-4d1115-8b4cdc999-vj6xh to ip-10-0-139-248.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6958bdd4ff-mjcfh

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6958bdd4ff-mjcfh to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-2dbf739c-75f684fcd9-zw8cw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-2dbf739c-75f684fcd9-zw8cw to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-1ec4b892-648fc646cf-wb6p8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1ec4b892-648fc646cf-wb6p8 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-7e439d04-588c697959-8dgrg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7e439d04-588c697959-8dgrg to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9 to ip-10-0-139-248.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6958bdd4ff-m66rf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6958bdd4ff-m66rf to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-b26c22-c85b5df6c-j5vvc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b26c22-c85b5df6c-j5vvc to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt to ip-10-0-139-248.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6958bdd4ff-bhc6f

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6958bdd4ff-bhc6f to ip-10-0-132-167.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-n87db

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-n87db to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5xbjdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5xbjdl to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p to ip-10-0-139-248.us-east-2.compute.internal

opendatahub

test-curl-7095-d9597e

Scheduled

Successfully assigned opendatahub/test-curl-7095-d9597e to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-p8b4c

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-p8b4c to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj to ip-10-0-139-248.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5bcd7997-h56sp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-h56sp to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-p9ckq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-p9ckq to ip-10-0-131-36.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-bsvp9

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bsvp9 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-67f556869f-kv4cs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-67f556869f-kv4cs to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-5b44f68b67-gwbxk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-5b44f68b67-gwbxk to ip-10-0-131-36.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5766f45f4c-4c24z

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5766f45f4c-4c24z to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-08111b-9cc448f95-n6ttb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-08111b-9cc448f95-n6ttb to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m to ip-10-0-139-248.us-east-2.compute.internal

opendatahub

maas-controller-bc865c477-q4c9z

Scheduled

Successfully assigned opendatahub/maas-controller-bc865c477-q4c9z to ip-10-0-131-36.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-gpqgh

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gpqgh to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-64455b-6d498zdbkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-64455b-6d498zdbkw to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-b5xcs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-b5xcs to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g to ip-10-0-139-248.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-wpzv6

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-wpzv6 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c87701ad-openshift-default-58f78ff59-b664t to ip-10-0-131-36.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-55dcdb647d-l4wrh

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-55dcdb647d-l4wrh to ip-10-0-131-36.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-55dcdb647d-8hjmz

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-55dcdb647d-8hjmz to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-57b966c675-69bbn

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-57b966c675-69bbn to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf to ip-10-0-132-167.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5546676475-98nhd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5546676475-98nhd to ip-10-0-131-36.us-east-2.compute.internal

opendatahub

maas-controller-bc865c477-mhwxn

Scheduled

Successfully assigned opendatahub/maas-controller-bc865c477-mhwxn to ip-10-0-131-36.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-hk472

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-hk472 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-ait-e04a4e0c-openshift-default-75674dbfb9-l6js4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e04a4e0c-openshift-default-75674dbfb9-l6js4 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk to ip-10-0-139-248.us-east-2.compute.internal

ai-tenants

e2e-api-b-418af8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-418af8: MaasTenantConfig is not available to restore revocation operands

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt to ip-10-0-131-36.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-fhvn2

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-fhvn2 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-xz4c4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-xz4c4 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-xtsb8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-xtsb8 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-xs5rk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-xs5rk to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-vrbqc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-vrbqc to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

Scheduled

Successfully assigned openshift-ingress/e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-ttvvr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-ttvvr to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

router-default-7f579888d9-ntt6m

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-7f579888d9-ntt6m

FailedScheduling

no nodes available to schedule pods

kuadrant-system

limitador-operator-controller-manager-5778bb4449-tzjk2

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-tzjk2 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-tb9j4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-tb9j4 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-sl776

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-sl776 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-nr5hn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-nr5hn to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-mnk7k

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-mnk7k to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-z544g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-z544g to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-k4c4j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-k4c4j to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-h2ns8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-h2ns8 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-92vh9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-92vh9 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-6sg42

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-6sg42 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-84587756dc-5v6m6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-84587756dc-5v6m6 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd to ip-10-0-139-248.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-zxjkh

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-zxjkh to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-84d8c65c8f-ltmbm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-84d8c65c8f-ltmbm to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-84d8c65c8f-j592j

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-84d8c65c8f-j592j to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg to ip-10-0-139-248.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-hqpn5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hqpn5 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp to ip-10-0-139-248.us-east-2.compute.internal

ai-tenants

e2e-api-a-dd2bbf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-dd2bbf: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff to ip-10-0-132-167.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-q6cdk

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-q6cdk to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-dvwqs to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4 to ip-10-0-132-167.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-7hvfd

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-7hvfd to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng to ip-10-0-131-36.us-east-2.compute.internal

llm

e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b

Scheduled

Successfully assigned llm/e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-ddsxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-ddsxv to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz to ip-10-0-139-248.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-6zhqm

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-6zhqm to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-945dt

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-945dt to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

maas-controller-bc865c477-6g9s8

Scheduled

Successfully assigned opendatahub/maas-controller-bc865c477-6g9s8 to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

test-curl-7089-68f9bf

Scheduled

Successfully assigned opendatahub/test-curl-7089-68f9bf to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-jw96h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-jw96h to ip-10-0-139-248.us-east-2.compute.internal

llm

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

Scheduled

Successfully assigned llm/e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-hxqrb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-hxqrb to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-b9tb7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-b9tb7 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k to ip-10-0-131-36.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-ghn7b

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-ghn7b to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-xjs5w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-xjs5w to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

router-default-7f579888d9-ntt6m

Scheduled

Successfully assigned openshift-ingress/router-default-7f579888d9-ntt6m to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl to ip-10-0-131-36.us-east-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-dgl5b

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-dgl5b to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5 to ip-10-0-131-36.us-east-2.compute.internal

llm

e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q

Scheduled

Successfully assigned llm/e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q to ip-10-0-139-248.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d to ip-10-0-131-36.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-24xgn

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-24xgn to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-4xldn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-4xldn to ip-10-0-139-248.us-east-2.compute.internal

opendatahub

test-curl-7092-17b551

Scheduled

Successfully assigned opendatahub/test-curl-7092-17b551 to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

maas-controller-5776b58b5b-q6zgl

Scheduled

Successfully assigned opendatahub/maas-controller-5776b58b5b-q6zgl to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

test-curl-7092-32cedd

Scheduled

Successfully assigned opendatahub/test-curl-7092-32cedd to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-8vqz6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-8vqz6 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-t76cc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-t76cc to ip-10-0-131-36.us-east-2.compute.internal

opendatahub

test-curl-7092-78af94

Scheduled

Successfully assigned opendatahub/test-curl-7092-78af94 to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

test-curl-7092-d752f5

Scheduled

Successfully assigned opendatahub/test-curl-7092-d752f5 to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

test-curl-7095-11eecc

Scheduled

Successfully assigned opendatahub/test-curl-7095-11eecc to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq to ip-10-0-131-36.us-east-2.compute.internal

opendatahub

test-curl-7095-4b5732

Scheduled

Successfully assigned opendatahub/test-curl-7095-4b5732 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5 to ip-10-0-131-36.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-ttdzp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-ttdzp to ip-10-0-131-36.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-jbr2p

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-jbr2p to ip-10-0-132-167.us-east-2.compute.internal

opendatahub

test-curl-7095-9856f4

Scheduled

Successfully assigned opendatahub/test-curl-7095-9856f4 to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-vfxjl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-vfxjl to ip-10-0-139-248.us-east-2.compute.internal

llm

e2e-same-id-a-6a354560

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-6a354560

llm

e2e-same-id-b-6a354560-kserve-69687b969c-bgqb7

Scheduled

Successfully assigned llm/e2e-same-id-b-6a354560-kserve-69687b969c-bgqb7 to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf to ip-10-0-139-248.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-fdc87559d-vj28t

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-fdc87559d-vj28t to ip-10-0-139-248.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j to ip-10-0-139-248.us-east-2.compute.internal

llm

e2e-same-id-b-6a354560

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-same-id-b-6a354560

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-6a354560

openshift-ingress

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv to ip-10-0-132-167.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7f579888d9 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x2)

openshift-ingress

replicaset-controller

router-default-7f579888d9

FailedCreate

Error creating: pods "router-default-7f579888d9-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-7f579888d9

SuccessfulCreate

Created pod: router-default-7f579888d9-ntt6m
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-7f579888d9-ntt6m

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-7f579888d9-ntt6m

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x3)

openshift-ingress

kubelet

router-default-7f579888d9-ntt6m

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-7f579888d9-ntt6m

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7f579888d9-ntt6m

Started

Container started

openshift-ingress

kubelet

router-default-7f579888d9-ntt6m

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-7f579888d9-ntt6m

Created

Container created

openshift-ingress

multus

router-default-7f579888d9-ntt6m

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-xjs5w

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-xjs5w

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xjs5w

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xjs5w

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xjs5w

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xjs5w

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 6.029s (6.029s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xjs5w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xjs5w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-6sg42

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-84587756dc from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-57b966c675

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-57b966c675-69bbn

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-57b966c675 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-57b966c675-69bbn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-57b966c675-69bbn

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-6sg42

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.142s (6.142s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-57b966c675-69bbn

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-57b966c675-69bbn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.165s (6.165s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-57b966c675-69bbn

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5965948766

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5965948766-45jjk

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5965948766

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5965948766-cg76t

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5965948766

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5965948766-qhxm9

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-5965948766 from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5965948766-45jjk

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-45jjk

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5965948766-qhxm9

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-qhxm9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5965948766-cg76t

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-cg76t

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-cg76t

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-45jjk

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-cg76t

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.945s (2.945s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-45jjk

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.885s (2.885s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-qhxm9

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-cg76t

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-qhxm9

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-qhxm9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.83s (2.83s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-45jjk

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-45jjk

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 486ms (486ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-45jjk

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-5965948766-45jjk_27539e43-aafa-4175-a5dd-e68401ad5cbe

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-5965948766-45jjk_27539e43-aafa-4175-a5dd-e68401ad5cbe became leader

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-24xgn

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-cg76t

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-qhxm9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-qhxm9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 402ms (402ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-qhxm9

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-qhxm9

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-45jjk

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-45jjk

Started

Container started
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-cg76t

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-cg76t

Created

Container created
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5965948766-cg76t

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 402ms (402ms including waiting). Image size: 273709574 bytes.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-24xgn

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-24xgn

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install
(x4)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-bzzrg

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-24xgn

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-24xgn_4824af6a-a91f-4ffd-9d6b-3d995a8f5367 became leader

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-24xgn

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.95s (2.95s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-24xgn

Started

Container started

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-t5l28

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-t5l28

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-t5l28

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-t5l28

Started

Container started

kuadrant-system

dns-operator-controller-manager-8557cbdb84-t5l28_db329178-7a05-4371-b780-67148631ad17

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-t5l28_db329178-7a05-4371-b780-67148631ad17 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-t5l28

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.849s (2.849s including waiting). Image size: 190804149 bytes.

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-tzjk2

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-t5l28

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-tzjk2

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-tzjk2

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

limitador-operator-controller-manager-5778bb4449-tzjk2_3c91734a-063a-4430-9afa-1f9682d2dde9

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-tzjk2_3c91734a-063a-4430-9afa-1f9682d2dde9 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-tzjk2

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-tzjk2

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-tzjk2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.909s (1.909s including waiting). Image size: 177967631 bytes.

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-jwwdm

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-p5jpw

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-jwwdm

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-jwwdm

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-p5jpw

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

authorino-operator-7b7bb4bc77-p5jpw

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-p5jpw

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-p5jpw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.169s (2.169s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-p5jpw

Created

Container created

kuadrant-system

authorino-operator-7b7bb4bc77-p5jpw_be759aae-4e06-42a1-83d7-bdfdaeb4a906

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-p5jpw_be759aae-4e06-42a1-83d7-bdfdaeb4a906 became leader

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-jwwdm

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-jwwdm

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-jwwdm

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.687s (3.687s including waiting). Image size: 309650901 bytes.

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-l28zx

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-l28zx

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-l28zx

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-l28zx

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-l28zx

Started

Container started

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-wpzv6

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-wpzv6

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-wpzv6

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

cert-manager

multus

cert-manager-597b95cb84-2hskc

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-2hskc

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-2hskc

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-2hskc

Started

Container started

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-2hskc

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7b67449fb5

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7b67449fb5mtj65

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-84d8c65c8f from 0 to 2

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-wpzv6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.999s (3.999s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-wpzv6

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-wpzv6

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-84d8c65c8f

SuccessfulCreate

Created pod: kube-auth-proxy-84d8c65c8f-j592j

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-84d8c65c8f

SuccessfulCreate

Created pod: kube-auth-proxy-84d8c65c8f-ltmbm

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7b67449fb5 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-wpzv6_fcf6a57a-88a2-4085-a508-dbcd58b6a0a5

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-wpzv6_fcf6a57a-88a2-4085-a508-dbcd58b6a0a5 became leader

openshift-ingress

kubelet

kube-auth-proxy-84d8c65c8f-j592j

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7b67449fb5mtj65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7b67449fb5mtj65

Created

Container created

openshift-ingress

multus

kube-auth-proxy-84d8c65c8f-j592j

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-84d8c65c8f-ltmbm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7b67449fb5mtj65

Started

Container started

openshift-ingress

multus

kube-auth-proxy-84d8c65c8f-ltmbm

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7b67449fb5mtj65

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-hk472

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

multus

limitador-limitador-74dfcfb894-hk472

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-84d8c65c8f-ltmbm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.466s (2.466s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-hk472

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-n87db

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-fhvn2

openshift-ingress

kubelet

kube-auth-proxy-84d8c65c8f-ltmbm

Started

Container started

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-8c92c

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-fhvn2

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-ingress

kubelet

kube-auth-proxy-84d8c65c8f-ltmbm

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-n87db

FailedMount

MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found

kuadrant-system

multus

limitador-limitador-7c9b87d574-fhvn2

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-8w2nb

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-84d8c65c8f-j592j

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-84d8c65c8f-j592j

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-nx2g7

openshift-ingress

kubelet

kube-auth-proxy-84d8c65c8f-j592j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.357s (2.357s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-n87db

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

multus

authorino-56c6c9ddd5-nx2g7

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-n87db

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-8w2nb

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-8c92c

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-8c92c

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-nx2g7

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-8w2nb

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-fhvn2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.197s (1.197s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-fhvn2

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-fhvn2

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-hk472

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.897s (2.897s including waiting). Image size: 133379307 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-8w2nb

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-8c92c

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.365s (2.365s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-8c92c

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-8c92c

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-8w2nb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.906s (1.906s including waiting). Image size: 195729000 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-hk472

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-nx2g7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.617s (2.617s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-hk472

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-8w2nb

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-nx2g7

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-8c92c

kuadrant-system

kubelet

authorino-56c6c9ddd5-nx2g7

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-n87db

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.913s (4.913s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-n87db

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-n87db

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-8c92c

Killing

Stopping container authorino

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-bsvp9

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-bsvp9

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-bsvp9

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-bsvp9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.022s (4.022s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-bsvp9

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-bsvp9

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-hk472

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-hk472

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

opendatahub

kserve-module-controller-manager-7566cf5fc8-8w2nb_677606af-70f2-4570-aceb-c70b0b3ec0a6

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-8w2nb_677606af-70f2-4570-aceb-c70b0b3ec0a6 became leader

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-wpzv6

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-wpzv6

Killing

Stopping container manager

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-9hzbd"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-sbxbs"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-fdc87559d from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-fdc87559d

SuccessfulCreate

Created pod: jobset-controller-manager-fdc87559d-vj28t

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

multus

jobset-controller-manager-fdc87559d-vj28t

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-fdc87559d-vj28t

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

kubelet

jobset-controller-manager-fdc87559d-vj28t

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-fdc87559d-vj28t

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.193s (3.193s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-fdc87559d-vj28t

Started

Container started

openshift-jobset-operator

jobset-controller-manager-fdc87559d-vj28t_67378dd0-76ef-40fa-adc6-f6b7c5ca7baa

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-fdc87559d-vj28t_67378dd0-76ef-40fa-adc6-f6b7c5ca7baa became leader

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5776b58b5b from 0 to 1

opendatahub

replicaset-controller

maas-controller-5776b58b5b

SuccessfulCreate

Created pod: maas-controller-5776b58b5b-q6zgl

opendatahub

multus

maas-controller-bc865c477-6g9s8

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-bc865c477

SuccessfulCreate

Created pod: maas-controller-bc865c477-6g9s8

opendatahub

kubelet

maas-controller-5776b58b5b-q6zgl

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02"

opendatahub

multus

maas-controller-5776b58b5b-q6zgl

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-bsvp9_37fc31cb-298e-43d2-b3b7-97b333b072cf

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-bsvp9_37fc31cb-298e-43d2-b3b7-97b333b072cf became leader

opendatahub

kubelet

maas-controller-5776b58b5b-q6zgl

Created

Container created

opendatahub

kubelet

maas-controller-5776b58b5b-q6zgl

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02" in 4.148s (4.148s including waiting). Image size: 200094742 bytes.

opendatahub

kubelet

maas-controller-5776b58b5b-q6zgl

Started

Container started

opendatahub

kubelet

maas-controller-bc865c477-6g9s8

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02" in 3.664s (3.664s including waiting). Image size: 200094742 bytes.

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-2trjw

opendatahub

maas-controller-5776b58b5b-q6zgl_b832b849-d0fa-4762-bc65-eb8549f15f5d

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5776b58b5b-q6zgl_b832b849-d0fa-4762-bc65-eb8549f15f5d became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-2trjw

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-2trjw

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

kubelet

kserve-controller-manager-776cc66d47-tbkh6

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-tbkh6

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-jbr2p

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

multus

kserve-controller-manager-776cc66d47-tbkh6

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-b9tb7

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-945dt

opendatahub

kubelet

odh-model-controller-769875db56-945dt

FailedMount

MountVolume.SetUp failed for volume "cert" : secret "odh-model-controller-webhook-cert" not found

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-6zhqm

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-b9tb7

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-jbr2p

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

opendatahub

multus

odh-model-controller-769875db56-945dt

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-945dt

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

kubelet

model-serving-api-75bd89fdfc-6zhqm

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jbr2p

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9tb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9tb7

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9tb7

Started

Container started

opendatahub

multus

model-serving-api-75bd89fdfc-6zhqm

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xjs5w

Killing

Stopping container discovery

opendatahub

kubelet

maas-controller-5776b58b5b-q6zgl

Killing

Stopping container manager

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5776b58b5b from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-xjs5w

opendatahub

replicaset-controller

maas-controller-5776b58b5b

SuccessfulDelete

Deleted pod: maas-controller-5776b58b5b-q6zgl

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jbr2p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.94s (3.94s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-6zhqm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.941s (3.941s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-945dt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.391s (4.391s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-6zhqm

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jbr2p

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-tbkh6

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-6zhqm

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-945dt

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jbr2p

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-945dt

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-tbkh6

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.022s (4.022s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-tbkh6

Created

Container created

opendatahub

odh-model-controller-769875db56-945dt_c17cda35-9889-4703-a391-d9d5eef2732b

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-945dt_c17cda35-9889-4703-a391-d9d5eef2732b became leader

opendatahub

kserve-controller-manager-776cc66d47-tbkh6_a2f0cd10-70d1-471a-b396-db6dcac78f8e

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-tbkh6_a2f0cd10-70d1-471a-b396-db6dcac78f8e became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-2trjw

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 14.105s (14.105s including waiting). Image size: 1089502687 bytes.

opendatahub

llmisvc-controller-manager-869d5dcc5d-jbr2p_8c78d67c-d929-443f-8753-d80f8092507e

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-jbr2p_8c78d67c-d929-443f-8753-d80f8092507e became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-2trjw

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-2trjw

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

maas-controller-bc865c477-6g9s8_fcb36f7e-a6f6-4cda-a766-6ee989db818d

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-bc865c477-6g9s8_fcb36f7e-a6f6-4cda-a766-6ee989db818d became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

ProbeError

Readiness probe error: Get "http://10.134.0.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Unhealthy

Readiness probe failed: Get "http://10.134.0.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Started

Container started

kuadrant-system

multus

authorino-6889cbd8c4-p4bbv

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-5588f885fc from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-5588f885fc

SuccessfulCreate

Created pod: authorino-5588f885fc-qvxj7

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-rj2vw

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-rj2vw

kuadrant-system

kubelet

authorino-6889cbd8c4-p4bbv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-p4bbv

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-p4bbv

kuadrant-system

kubelet

authorino-6889cbd8c4-p4bbv

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-p4bbv

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-p4bbv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 799ms (799ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5588f885fc-qvxj7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 598ms (598ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-p4bbv

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-5588f885fc-qvxj7

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-5588f885fc-qvxj7

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

ProbeError

Startup probe error: Get "http://10.134.0.18:15021/healthz/ready": dial tcp 10.134.0.18:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Unhealthy

Startup probe failed: Get "http://10.134.0.18:15021/healthz/ready": dial tcp 10.134.0.18:15021: connect: connection refused

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-nx2g7

kuadrant-system

kubelet

authorino-56c6c9ddd5-nx2g7

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-5588f885fc-qvxj7

Created

Container created

kuadrant-system

kubelet

authorino-5588f885fc-qvxj7

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

llmisvc-controller-manager-6466c554d8-p8b4c

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-p8b4c

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-p8b4c

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-p8b4c

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-p8b4c

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-p8b4c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 380ms (380ms including waiting). Image size: 235100981 bytes.

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jbr2p

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-jbr2p

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulCreate

Created pod: ai-gateway-controller-5d8dddb676-vts47

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5d8dddb676 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-vts47

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-5d8dddb676-vts47

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-vts47

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-vts47

Started

Container started

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-vts47

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.397s (1.397s including waiting). Image size: 183979430 bytes.

opendatahub

ai-gateway-controller-5d8dddb676-vts47_14ae9a2c-bac7-47a3-8bdc-251c9dcf8b67

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5d8dddb676-vts47_14ae9a2c-bac7-47a3-8bdc-251c9dcf8b67 became leader

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-khw76

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-khw76
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-7b98bb678c-p9ckq

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-55fbbbf9dc-khw76

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-p9ckq

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-p9ckq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-khw76

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.213s (2.213s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-p9ckq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.223s (2.223s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-p9ckq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-p9ckq

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-khw76

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-khw76

Created

Container created

opendatahub

replicaset-controller

ai-gateway-controller-6f5b4db54

SuccessfulCreate

Created pod: ai-gateway-controller-6f5b4db54-wxw9w

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6f5b4db54 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-6f5b4db54-wxw9w

Created

Container created

opendatahub

kubelet

ai-gateway-controller-6f5b4db54-wxw9w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 404ms (404ms including waiting). Image size: 183979430 bytes.

opendatahub

kubelet

ai-gateway-controller-6f5b4db54-wxw9w

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6f5b4db54-wxw9w

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-6f5b4db54-wxw9w

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

opendatahub

llmisvc-controller-manager-6466c554d8-p8b4c_91f4caba-8af1-4bf8-b49e-b9cfc62bbbd1

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-p8b4c_91f4caba-8af1-4bf8-b49e-b9cfc62bbbd1 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-5d8dddb676 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulDelete

Deleted pod: ai-gateway-controller-5d8dddb676-vts47

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-vts47

Killing

Stopping container manager

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.409s (1.409s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q6cdk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-q6cdk

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-q6cdk

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q6cdk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 303ms (303ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q6cdk

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q6cdk

Started

Container started

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-7hvfd

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7hvfd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-7hvfd

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-dgl5b

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-dgl5b

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 367ms (367ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-dgl5b

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7hvfd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.387s (1.387s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7hvfd

Created

Container created

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-dgl5b

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7hvfd

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-dgl5b

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-dgl5b

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-ghn7b

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

kubelet

echo-simulator-kserve-64b6f8f96c-ghn7b

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

multus

echo-simulator-kserve-64b6f8f96c-ghn7b

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 309ms (309ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d

Started

Container started

opendatahub

ai-gateway-controller-6f5b4db54-wxw9w_cc22988a-9031-44ca-a129-54e3fb5f2a4d

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6f5b4db54-wxw9w_cc22988a-9031-44ca-a129-54e3fb5f2a4d became leader

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-ghn7b

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-ghn7b

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-ghn7b

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.825s (1.825s including waiting). Image size: 78208878 bytes.

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-zxjkh

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-zxjkh

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-zxjkh

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-zxjkh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-zxjkh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 340ms (340ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-zxjkh

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-bc865c477-6g9s8

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-84587756dc from 1 to 3

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

opendatahub

kubelet

maas-controller-bc865c477-6g9s8

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02" in 438ms (438ms including waiting). Image size: 200094742 bytes.

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-xtsb8

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping
(x2)

opendatahub

kubelet

maas-controller-bc865c477-6g9s8

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes
(x2)

opendatahub

kubelet

maas-controller-bc865c477-6g9s8

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-sl776

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-xtsb8

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 331ms (331ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-sl776

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-sl776

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-sl776

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-sl776

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-sl776

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.194s (3.194s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.217s (5.217s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-sl776

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-sl776

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-h2ns8

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-5v6m6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-mnk7k

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-h2ns8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-84587756dc from 3 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-mnk7k

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-5v6m6

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

Created

Container created

opendatahub

maas-controller-bc865c477-6g9s8_8719ffcb-d81d-41ec-91d4-fea6e52b456c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-bc865c477-6g9s8_8719ffcb-d81d-41ec-91d4-fea6e52b456c became leader

kuadrant-system

replicaset-controller

authorino-796d65f566

SuccessfulCreate

Created pod: authorino-796d65f566-65br2

kuadrant-system

kubelet

authorino-796d65f566-65br2

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-796d65f566-65br2

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-796d65f566-65br2

Started

Container started

kuadrant-system

kubelet

authorino-796d65f566-65br2

Created

Container created

kuadrant-system

kubelet

authorino-796d65f566-65br2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.001s (2.001s including waiting). Image size: 204096810 bytes.
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-5588f885fc from 1 to 0
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

kuadrant-system

replicaset-controller

authorino-5588f885fc

SuccessfulDelete

Deleted pod: authorino-5588f885fc-qvxj7

kuadrant-system

kubelet

authorino-5588f885fc-qvxj7

Killing

Stopping container authorino
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-ttvvr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-ttvvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-84587756dc-ttvvr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-z544g

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-xz4c4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-xz4c4

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-z544g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-ttvvr

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-z544g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-z544g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-vrbqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xz4c4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xz4c4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-84587756dc from 6 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xz4c4

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-z544g

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-ttvvr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-vrbqc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-vrbqc

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-vrbqc

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-vrbqc

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-vrbqc

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-ttvvr

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-ttvvr

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xz4c4

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-z544g

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-vrbqc

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-z544g

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xz4c4

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-a4ab8e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-a4ab8e

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-e440bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-e440bc

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-c381a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-c381a7

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-e440bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-e440bc-85679c9659 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-c381a7: serviceaccount "payload-processing-e2e-worker-w4-c381a7" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e440bc: serviceaccount "payload-processing-e2e-worker-w2-e440bc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-e440bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e440bc-85679c9659

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-e440bc-85679c9659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e440bc: serviceaccount "payload-processing-e2e-worker-w2-e440bc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e440bc-85679c9659

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

openshift-ingress

multus

payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-c381a7-558f76676f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-c381a7-558f76676f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-c381a7: serviceaccount "payload-processing-e2e-worker-w4-c381a7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-c381a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-c381a7-558f76676f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-c381a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-c381a7-558f76676f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a4ab8e: serviceaccount "payload-processing-e2e-worker-w0-a4ab8e" not found

openshift-ingress

multus

payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-a4ab8e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-a4ab8e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a4ab8e: serviceaccount "payload-processing-e2e-worker-w0-a4ab8e" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.704s (3.704s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.435s (2.435s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.289s (3.289s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.51s (3.51s including waiting). Image size: 125353963 bytes.
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-17adbf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-17adbf-openshift-default-75f4498d49 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-17adbf-openshift-default-75f4498d49

SuccessfulCreate

Created pod: e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

openshift-ingress

gateway_labeler_controller

e2e-inf-a-17adbf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-17adbf

openshift-ingress

multus

e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-17adbf-dc946b59f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-17adbf: serviceaccount "payload-processing-e2e-inf-a-17adbf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-17adbf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-17adbf-dc946b59f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-17adbf-dc946b59f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-17adbf-dc946b59f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-17adbf: serviceaccount "payload-processing-e2e-inf-a-17adbf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-17adbf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f

SuccessfulCreate

Created pod: e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

openshift-ingress

gateway_labeler_controller

e2e-inf-b-db71f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-db71f4

openshift-ingress

multus

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-db71f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-db71f4-openshift-default-5c5dc9b98f from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-db71f4: serviceaccount "payload-processing-e2e-inf-b-db71f4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-db71f4-57c44dc4f9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-db71f4-57c44dc4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-db71f4: serviceaccount "payload-processing-e2e-inf-b-db71f4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-db71f4-57c44dc4f9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj
(x2)

openshift-ingress

kubelet

e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-db71f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-db71f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-db71f4-57c44dc4f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq
(x5)

openshift-ingress

kubelet

e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 1 to 2

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-17adbf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-17adbf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 2 to 3

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-db71f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-db71f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-db71f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-db71f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7092-17b551

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7092-17b551

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

opendatahub

kubelet

test-curl-7092-17b551

Started

Container started

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

opendatahub

kubelet

test-curl-7092-17b551

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.431s (1.431s including waiting). Image size: 106100986 bytes.

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

opendatahub

kubelet

test-curl-7092-17b551

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

Created

Container created

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

Created

Container created

opendatahub

kubelet

test-curl-7092-78af94

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7092-78af94

Created

Container created

opendatahub

kubelet

test-curl-7092-78af94

Started

Container started

opendatahub

multus

test-curl-7092-78af94

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7092-17b551

Killing

Stopping container test-curl-7092-17b551

opendatahub

kubelet

test-curl-7092-78af94

Killing

Stopping container test-curl-7092-78af94

openshift-ingress

deployment-controller

e2e-extmod-a-ded926-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ded926-openshift-default-6bdf65b545 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-ded926-openshift-default-6bdf65b545

SuccessfulCreate

Created pod: e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ded926

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ded926
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ded926

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ded926-79455f68bc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ded926-79455f68bc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ded926-79455f68bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ded926: serviceaccount "payload-processing-e2e-extmod-a-ded926" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ded926

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ded926-79455f68bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ded926: serviceaccount "payload-processing-e2e-extmod-a-ded926" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 4 to 6

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

Created

Container created

openshift-ingress

multus

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-7c192b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-7c192b
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-hqpn5

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-7c192b-f6b6648b9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-7c192b-f6b6648b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-7c192b: serviceaccount "payload-processing-e2e-extmod-b-7c192b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-7c192b-f6b6648b9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-7c192b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-7c192b-f6b6648b9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-7c192b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-7c192b: serviceaccount "payload-processing-e2e-extmod-b-7c192b" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 5 to 9

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

Started

Container started

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hqpn5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-hqpn5

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

Created

Container created

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Unhealthy

Liveness probe failed: Get "https://10.134.0.34:8000/health": context deadline exceeded

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hqpn5

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hqpn5

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hqpn5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 8.354s (8.354s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hqpn5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hqpn5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ded926-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ded926-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-a2ccd8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-a2ccd8

openshift-ingress

replicaset-controller

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7

SuccessfulCreate

Created pod: e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

openshift-ingress

deployment-controller

e2e-praxis-a-a2ccd8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a2ccd8-openshift-default-798b597bf7 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a2ccd8: serviceaccount "payload-processing-e2e-praxis-a-a2ccd8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a2ccd8: serviceaccount "payload-processing-e2e-praxis-a-a2ccd8" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ded926-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-a2ccd8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ded926-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-a2ccd8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

Started

Container started

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

Created

Container created

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b26c22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b26c22

openshift-ingress

deployment-controller

e2e-praxis-b-b26c22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b26c22-openshift-default-5d5cff7997 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-b26c22-openshift-default-5d5cff7997

SuccessfulCreate

Created pod: e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

openshift-ingress

multus

e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b26c22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b26c22-c85b5df6c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b26c22-cc548f947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b26c22: serviceaccount "payload-processing-e2e-praxis-b-b26c22" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b26c22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b26c22-cc548f947 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b26c22-c85b5df6c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b26c22-c85b5df6c-j5vvc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b26c22-c85b5df6c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b26c22-c85b5df6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b26c22: serviceaccount "payload-processing-e2e-praxis-b-b26c22" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b26c22-cc548f947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-ddsxv

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b26c22-c85b5df6c-j5vvc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b26c22-c85b5df6c-j5vvc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-b26c22-c85b5df6c-j5vvc

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b26c22-c85b5df6c-j5vvc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-ddsxv

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-ddsxv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-ddsxv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-ddsxv

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 4 to 7

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

Created

Container created

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Unhealthy

Liveness probe failed: Get "https://10.134.0.34:8000/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a2ccd8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a2ccd8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b26c22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b26c22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-17adbf-openshift-default-75f4498d49-hsbdd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-17adbf-696b5d5d7f-9fqx5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-17adbf-dc946b59f-9v2wg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b26c22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b26c22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-b-db71f4-openshift-default-5c5dc9b98f-knmrn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-d3ca48

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-d3ca48

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-d3ca48: serviceaccount "payload-processing-e2e-worker-w3-d3ca48" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-d3ca48: serviceaccount "payload-processing-e2e-worker-w3-d3ca48" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-db71f4-57c44dc4f9-lqfgj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-d3ca48

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-d3ca48-8f8dc6499 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-db71f4-6b76577dd7-cgpqq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-d3ca48

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9 from 0 to 1
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-a-a2ccd8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a2ccd8-openshift-default-798b597bf7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a2ccd8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7

SuccessfulCreate

Created pod: e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

Started

Container started
(x10)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-84587756dc-ttvvr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-84587756dc-xz4c4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-84587756dc-6sg42

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xz4c4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-ttvvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-6sg42

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wgzsc

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": context deadline exceeded

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 7 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

Started

Container started

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

Unhealthy

Startup probe failed: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

ProbeError

Startup probe error: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ef1693

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ef1693

openshift-ingress

deployment-controller

e2e-extmod-a-ef1693-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ef1693-openshift-default-66b997ddf7 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-ef1693-openshift-default-66b997ddf7

SuccessfulCreate

Created pod: e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ef1693-54fb5894cf

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ef1693

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ef1693-54fb5894cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ef1693-54fb5894cf

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ef1693-54fb5894cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ef1693: serviceaccount "payload-processing-e2e-extmod-a-ef1693" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ef1693

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ef1693: serviceaccount "payload-processing-e2e-extmod-a-ef1693" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a2ccd8-7f74875bbc-jrcdz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-8fcdn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a2ccd8-69fbbfb657-2jvf9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-a2ccd8-openshift-default-798b597bf7-5ljc2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c

SuccessfulCreate

Created pod: e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-1a18c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-1a18c8

openshift-ingress

deployment-controller

e2e-extmod-b-1a18c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-1a18c8-openshift-default-67d7b5995c from 0 to 1

openshift-ingress

multus

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-021a5a5c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-021a5a5c

openshift-ingress

replicaset-controller

e2e-ait-021a5a5c-openshift-default-6549bd658f

SuccessfulCreate

Created pod: e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

openshift-ingress

deployment-controller

e2e-ait-021a5a5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-021a5a5c-openshift-default-6549bd658f from 0 to 1

openshift-ingress

kubelet

e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

Created

Container created

openshift-ingress

kubelet

e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-1a18c8: serviceaccount "payload-processing-e2e-extmod-b-1a18c8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-1a18c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-1a18c8-5d757dc685 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-1a18c8-5d757dc685

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-1a18c8-5d757dc685

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-1a18c8-5d757dc685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-1a18c8: serviceaccount "payload-processing-e2e-extmod-b-1a18c8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-1a18c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-021a5a5c-58589f959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-021a5a5c-58589f959-92jwh

openshift-ingress

multus

payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-021a5a5c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-021a5a5c-58589f959 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

ProbeError

Readiness probe error: Get "http://10.134.0.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

Unhealthy

Readiness probe failed: Get "http://10.134.0.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-021a5a5c-58589f959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-021a5a5c-58589f959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-021a5a5c: serviceaccount "payload-processing-e2e-ait-021a5a5c" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-021a5a5c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-021a5a5c-859d56dfc9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-021a5a5c-859d56dfc9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-021a5a5c-859d56dfc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-021a5a5c: serviceaccount "payload-processing-e2e-ait-021a5a5c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-021a5a5c-859d56dfc9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-021a5a5c-859d56dfc9-6prfw

openshift-ingress

multus

payload-processing-e2e-ait-021a5a5c-859d56dfc9-6prfw

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-021a5a5c-58589f959-92jwh

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-021a5a5c-859d56dfc9-6prfw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-021a5a5c-58589f959-92jwh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-021a5a5c-859d56dfc9-6prfw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-021a5a5c-58589f959-92jwh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-021a5a5c-58589f959-92jwh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-021a5a5c-859d56dfc9-6prfw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b26c22-c85b5df6c-j5vvc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b26c22-cc548f947-ddsxv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-b26c22-openshift-default-5d5cff7997-fzr55

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-8f8aa8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-8f8aa8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-8f8aa8

openshift-ingress

replicaset-controller

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7

SuccessfulCreate

Created pod: e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

openshift-ingress

multus

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-8f8aa8: serviceaccount "payload-processing-e2e-shared-a-w0-8f8aa8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-8f8aa8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-8f8aa8: serviceaccount "payload-processing-e2e-shared-a-w0-8f8aa8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-8f8aa8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

Unhealthy

Startup probe failed: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

ProbeError

Startup probe error: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-021a5a5c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-dvwqs
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-021a5a5c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

Unhealthy

Readiness probe failed: Get "http://10.134.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-021a5a5c-58589f959-92jwh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

ProbeError

Readiness probe error: Get "http://10.134.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.21s (3.21s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-021a5a5c-859d56dfc9-6prfw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-021a5a5c-openshift-default-6549bd658f-6kfpj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c

SuccessfulCreate

Created pod: e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

openshift-ingress

gateway_labeler_controller

e2e-migrate-2dbf739c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2dbf739c-gw

openshift-ingress

deployment-controller

e2e-migrate-2dbf739c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c from 0 to 1

openshift-ingress

kubelet

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

Created

Container created

openshift-ingress

kubelet

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

openshift-ingress

deployment-controller

e2e-shared-b-w0-9add72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-9add72-openshift-default-c7769bc6c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-9add72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-9add72

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-2dbf739c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2dbf739c: serviceaccount "payload-processing-e2e-migrate-2dbf739c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-2dbf739c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-2dbf739c-75f684fcd9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2dbf739c-75f684fcd9

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-2dbf739c-75f684fcd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2dbf739c: serviceaccount "payload-processing-e2e-migrate-2dbf739c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1a18c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2dbf739c-75f684fcd9

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-2dbf739c-75f684fcd9-zw8cw

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1a18c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-migrate-2dbf739c-75f684fcd9-zw8cw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-2dbf739c-75f684fcd9-zw8cw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-2dbf739c-75f684fcd9-zw8cw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-migrate-2dbf739c-75f684fcd9-zw8cw

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.749s (2.749s including waiting). Image size: 125353963 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-9add72: serviceaccount "payload-processing-e2e-shared-b-w0-9add72" not found
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef1693-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-9add72: serviceaccount "payload-processing-e2e-shared-b-w0-9add72" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-9add72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-9add72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f from 0 to 1
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef1693-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-2dbf739c-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-2dbf739c-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-2dbf739c-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-2dbf739c-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 9 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1a18c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1a18c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-migrate-2dbf739c-75f684fcd9-zw8cw

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-extmod-a-ef1693-openshift-default-66b997ddf7

SuccessfulCreate

Created pod: e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

openshift-ingress

deployment-controller

e2e-extmod-a-ef1693-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ef1693-openshift-default-66b997ddf7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef1693-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dbf739c-6976fdf8c9-f4jpd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

Killing

Stopping container istio-proxy
(x9)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-e04a4e0c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e04a4e0c

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

Created

Container created

openshift-ingress

deployment-controller

e2e-ait-e04a4e0c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e04a4e0c-openshift-default-75674dbfb9 from 0 to 1

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

Started

Container started

openshift-ingress

replicaset-controller

e2e-ait-e04a4e0c-openshift-default-75674dbfb9

SuccessfulCreate

Created pod: e2e-ait-e04a4e0c-openshift-default-75674dbfb9-l6js4

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-e04a4e0c-openshift-default-75674dbfb9-l6js4

Created

Container created

openshift-ingress

multus

e2e-ait-e04a4e0c-openshift-default-75674dbfb9-l6js4

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-e04a4e0c-openshift-default-75674dbfb9-l6js4

Started

Container started

openshift-ingress

kubelet

e2e-ait-e04a4e0c-openshift-default-75674dbfb9-l6js4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e04a4e0c-5645d65955

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e04a4e0c-5645d65955-7g5s4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e04a4e0c: serviceaccount "payload-processing-e2e-ait-e04a4e0c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-jx5xc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e04a4e0c-5645d65955

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e04a4e0c-5645d65955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e04a4e0c: serviceaccount "payload-processing-e2e-ait-e04a4e0c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e04a4e0c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e04a4e0c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e04a4e0c-5645d65955 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-e04a4e0c-5645d65955-7g5s4

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-jx5xc

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-jx5xc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-jx5xc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-e04a4e0c-5645d65955-7g5s4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-e04a4e0c-5645d65955-7g5s4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-e04a4e0c-5645d65955-7g5s4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-jx5xc

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

ProbeError

Readiness probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-2dbf739c-gw-openshift-default-64b7d84c5c-kmkgg

Unhealthy

Readiness probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

Started

Container started

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w0-9add72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-9add72-openshift-default-c7769bc6c from 1 to 4

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

Unhealthy

Startup probe failed: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

ProbeError

Startup probe error: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 3 to 5

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7

SuccessfulCreate

Created pod: e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

openshift-ingress

deployment-controller

e2e-shared-a-w0-8f8aa8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8f8aa8-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7

SuccessfulCreate

Created pod: e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

Created

Container created

openshift-ingress

multus

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e04a4e0c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e04a4e0c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

Unhealthy

Startup probe failed: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-e04a4e0c-5645d65955-7g5s4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e04a4e0c-6c7f8c7fc9-jx5xc

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

ProbeError

Startup probe error: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-e04a4e0c-openshift-default-75674dbfb9-l6js4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-c87701ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c87701ad

openshift-ingress

deployment-controller

e2e-ait-c87701ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c87701ad-openshift-default-58f78ff59 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-c87701ad-openshift-default-58f78ff59

SuccessfulCreate

Created pod: e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

openshift-ingress

kubelet

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

Created

Container created

openshift-ingress

kubelet

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

Started

Container started

openshift-ingress

multus

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8f8aa8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8f8aa8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c87701ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c87701ad-b469d86dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c87701ad-6ccb48d5c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c87701ad-6ccb48d5c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c87701ad: serviceaccount "payload-processing-e2e-ait-c87701ad" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c87701ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c87701ad-6ccb48d5c7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c87701ad-b469d86dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c87701ad-b469d86dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c87701ad: serviceaccount "payload-processing-e2e-ait-c87701ad" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-c87701ad-6ccb48d5c7-hzscz

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c87701ad-6ccb48d5c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c87701ad-6ccb48d5c7-hzscz

openshift-ingress

kubelet

payload-processing-e2e-ait-c87701ad-6ccb48d5c7-hzscz

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c87701ad-b469d86dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c87701ad-b469d86dc-4mcbq

openshift-ingress

kubelet

payload-processing-e2e-ait-c87701ad-6ccb48d5c7-hzscz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-c87701ad-6ccb48d5c7-hzscz

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c87701ad-b469d86dc-4mcbq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c87701ad-b469d86dc-4mcbq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-c87701ad-b469d86dc-4mcbq

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c87701ad-b469d86dc-4mcbq

Created

Container created

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w0-9add72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-9add72-openshift-default-c7769bc6c from 4 to 8

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

Started

Container started

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulDelete

Deleted pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulDelete

Deleted pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulDelete

Deleted pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8f8aa8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-2jswl

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8f8aa8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-n4t7b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-lldw4

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

ProbeError

Startup probe error: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

Unhealthy

Startup probe failed: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c87701ad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c87701ad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-a62d22-openshift-default-d9c57bf65

SuccessfulCreate

Created pod: e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

openshift-ingress

deployment-controller

e2e-extmod-a-a62d22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a62d22-openshift-default-d9c57bf65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-a62d22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a62d22

openshift-ingress

kubelet

payload-processing-e2e-ait-c87701ad-6ccb48d5c7-hzscz

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c87701ad-b469d86dc-4mcbq

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

Started

Container started

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-a62d22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a62d22: serviceaccount "payload-processing-e2e-extmod-a-a62d22" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a62d22-6746df564f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-a62d22-6746df564f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a62d22: serviceaccount "payload-processing-e2e-extmod-a-a62d22" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-a62d22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-a62d22-6746df564f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a62d22-6746df564f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb

openshift-ingress

gateway_labeler_controller

e2e-derive-ef15d972

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ef15d972

openshift-ingress

kubelet

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-ef15d972-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ef15d972-openshift-default-58bd498f85 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

Unhealthy

Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

ProbeError

Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-derive-ef15d972-openshift-default-58bd498f85

SuccessfulCreate

Created pod: e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb

Created

Container created

openshift-ingress

multus

e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks

Created

Container created

openshift-ingress

kubelet

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-c87701ad-openshift-default-58f78ff59-b664t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks

Started

Container started
(x11)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ef15d972

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ef15d972-6c89559d89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ef15d972

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ef15d972-75849948ff from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ef15d972-6c89559d89

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ef15d972-6c89559d89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ef15d972: serviceaccount "payload-processing-e2e-derive-ef15d972" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-ef15d972-6c89559d89-rrz7f

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ef15d972-75849948ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ef15d972-75849948ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ef15d972: serviceaccount "payload-processing-e2e-derive-ef15d972" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ef15d972-75849948ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ef15d972-75849948ff-bz4sc

openshift-ingress

multus

payload-processing-e2e-derive-ef15d972-6c89559d89-rrz7f

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-ef15d972-6c89559d89-rrz7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ef15d972-6c89559d89

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ef15d972-6c89559d89-rrz7f

openshift-ingress

kubelet

payload-processing-e2e-derive-ef15d972-6c89559d89-rrz7f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ef15d972-75849948ff-bz4sc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ef15d972-75849948ff-bz4sc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ef15d972-75849948ff-bz4sc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-derive-ef15d972-75849948ff-bz4sc

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8f8aa8-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7

SuccessfulCreate

Created pod: e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

openshift-ingress

deployment-controller

e2e-shared-a-w0-8f8aa8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7 from 3 to 4

openshift-ingress

multus

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-cf53a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-cf53a4

openshift-ingress

deployment-controller

e2e-extmod-b-cf53a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-cf53a4-openshift-default-866d74b569 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-cf53a4-openshift-default-866d74b569

SuccessfulCreate

Created pod: e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-ttdzp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-cf53a4: serviceaccount "payload-processing-e2e-extmod-b-cf53a4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-cf53a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-cf53a4-6689d89fbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-cf53a4-6689d89fbf

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-9mxzh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-cf53a4-6689d89fbf

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-cf53a4: serviceaccount "payload-processing-e2e-extmod-b-cf53a4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-cf53a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-ttdzp

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-9mxzh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-9mxzh

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-ttdzp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-ttdzp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-9mxzh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-ttdzp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-9mxzh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-ef15d972-6c89559d89-rrz7f

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ef15d972-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ef15d972-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ef15d972-75849948ff-bz4sc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks

ProbeError

Readiness probe error: Get "http://10.132.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-derive-ef15d972-openshift-default-58bd498f85-wxmks

Unhealthy

Readiness probe failed: Get "http://10.132.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

Unhealthy

Readiness probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

ProbeError

Readiness probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a62d22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a62d22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x9)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-bf6dd6dcc

FailedCreate

Error creating: pods "payload-processing-external-model-bf6dd6dcc-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-bf6dd6dcc from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-bf6dd6dcc

SuccessfulCreate

Created pod: payload-processing-external-model-bf6dd6dcc-gwprz

models-as-a-service

multus

payload-processing-external-model-bf6dd6dcc-gwprz

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-bf6dd6dcc-gwprz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-bf6dd6dcc-gwprz

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-bf6dd6dcc-gwprz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7089-68f9bf

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7089-68f9bf

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

ProbeError

Readiness probe error: Get "http://10.134.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

Unhealthy

Readiness probe failed: Get "http://10.134.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

multus

test-curl-7089-68f9bf

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7089-68f9bf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

Created

Container created

opendatahub

kubelet

test-curl-7089-68f9bf

Killing

Stopping container test-curl-7089-68f9bf
(x5)

openshift-ingress

kubelet

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-cf53a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-cf53a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w0-9add72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-9add72-openshift-default-c7769bc6c from 8 to 10

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

(combined from similar events): Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulCreate

Created pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

Started

Container started

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a62d22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a62d22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-xs5rk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-tb9j4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-nr5hn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-tb9j4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xs5rk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-nr5hn

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xs5rk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xs5rk

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-cf53a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-tb9j4

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-tb9j4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-tb9j4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-xs5rk

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-cf53a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-tb9j4

Unhealthy

Startup probe failed: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xs5rk

Unhealthy

Startup probe failed: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-tb9j4

ProbeError

Startup probe error: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xs5rk

ProbeError

Startup probe error: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-877757f87 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-877757f87

SuccessfulCreate

Created pod: payload-processing-external-model-877757f87-7znqp

models-as-a-service

kubelet

payload-processing-external-model-877757f87-7znqp

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-877757f87-7znqp

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-877757f87-7znqp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-877757f87-7znqp

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulDelete

Deleted pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulDelete

Deleted pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-b662x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-8m68w

Killing

Stopping container istio-proxy

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-bf6dd6dcc from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-bf6dd6dcc-gwprz

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-bf6dd6dcc

SuccessfulDelete

Deleted pod: payload-processing-external-model-bf6dd6dcc-gwprz

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1a18c8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c

SuccessfulCreate

Created pod: e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

openshift-ingress

deployment-controller

e2e-extmod-b-1a18c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-1a18c8-openshift-default-67d7b5995c from 1 to 2

openshift-ingress

multus

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-6958bdd4ff

SuccessfulCreate

Created pod: payload-processing-external-model-6958bdd4ff-m66rf

models-as-a-service

multus

payload-processing-external-model-6958bdd4ff-m66rf

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-m66rf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-m66rf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-m66rf

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-6958bdd4ff

SuccessfulDelete

Deleted pod: payload-processing-external-model-6958bdd4ff-m66rf

models-as-a-service

replicaset-controller

payload-processing-external-model-55dcdb647d

SuccessfulCreate

Created pod: payload-processing-external-model-55dcdb647d-8hjmz

models-as-a-service

replicaset-controller

payload-processing-external-model-6958bdd4ff

SuccessfulCreate

Created pod: payload-processing-external-model-6958bdd4ff-zdwmx

models-as-a-service

replicaset-controller

payload-processing-external-model-55dcdb647d

SuccessfulDelete

Deleted pod: payload-processing-external-model-55dcdb647d-8hjmz
(x3)

models-as-a-service

kubelet

payload-processing-external-model-55dcdb647d-8hjmz

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-64a3f5248b8f" not found

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-zdwmx

Started

Container started

models-as-a-service

multus

payload-processing-external-model-6958bdd4ff-zdwmx

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-zdwmx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-m66rf

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-zdwmx

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-zdwmx

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-6958bdd4ff

SuccessfulDelete

Deleted pod: payload-processing-external-model-6958bdd4ff-zdwmx
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-55dcdb647d from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-55dcdb647d

SuccessfulCreate

Created pod: payload-processing-external-model-55dcdb647d-l4wrh

models-as-a-service

multus

payload-processing-external-model-55dcdb647d-l4wrh

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-55dcdb647d-l4wrh

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-55dcdb647d-l4wrh

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-55dcdb647d-l4wrh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-6958bdd4ff

SuccessfulCreate

Created pod: payload-processing-external-model-6958bdd4ff-mjcfh

models-as-a-service

replicaset-controller

payload-processing-external-model-55dcdb647d

SuccessfulDelete

Deleted pod: payload-processing-external-model-55dcdb647d-l4wrh
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-55dcdb647d from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-55dcdb647d-l4wrh

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-mjcfh

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-mjcfh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-mjcfh

Started

Container started

models-as-a-service

multus

payload-processing-external-model-6958bdd4ff-mjcfh

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-6958bdd4ff

SuccessfulDelete

Deleted pod: payload-processing-external-model-6958bdd4ff-mjcfh

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

models-as-a-service

replicaset-controller

payload-processing-external-model-5766f45f4c

SuccessfulCreate

Created pod: payload-processing-external-model-5766f45f4c-4c24z

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulDelete

Deleted pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5766f45f4c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulDelete

Deleted pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-kjbs5

Killing

Stopping container istio-proxy

models-as-a-service

replicaset-controller

payload-processing-external-model-6958bdd4ff

SuccessfulCreate

Created pod: payload-processing-external-model-6958bdd4ff-bhc6f

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

Killing

Stopping container istio-proxy

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5766f45f4c from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5766f45f4c

SuccessfulDelete

Deleted pod: payload-processing-external-model-5766f45f4c-4c24z
(x4)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6958bdd4ff from 0 to 1

models-as-a-service

multus

payload-processing-external-model-6958bdd4ff-bhc6f

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-bhc6f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-mjcfh

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-bhc6f

Created

Container created
(x3)

models-as-a-service

kubelet

payload-processing-external-model-5766f45f4c-4c24z

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-36a6915adee5" not found

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-bhc6f

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-08111b-openshift-default-5b6dd8787c

SuccessfulCreate

Created pod: e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

openshift-ingress

deployment-controller

e2e-worker-w1-08111b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-08111b-openshift-default-5b6dd8787c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-08111b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-08111b

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-rddcl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-877757f87

SuccessfulDelete

Deleted pod: payload-processing-external-model-877757f87-7znqp

models-as-a-service

kubelet

payload-processing-external-model-877757f87-7znqp

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-08111b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-08111b: serviceaccount "payload-processing-e2e-worker-w1-08111b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-08111b-9cc448f95

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-08111b-9cc448f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-08111b: serviceaccount "payload-processing-e2e-worker-w1-08111b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-08111b-9cc448f95

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-08111b-9cc448f95-n6ttb

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-08111b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-08111b-9cc448f95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-b5xcs

openshift-ingress

multus

payload-processing-e2e-worker-w1-08111b-9cc448f95-n6ttb

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-08111b-9cc448f95-n6ttb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-b5xcs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-08111b-9cc448f95-n6ttb

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-b5xcs

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-08111b-9cc448f95-n6ttb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-b5xcs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-b5xcs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-b-1a18c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-1a18c8-openshift-default-67d7b5995c from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1a18c8-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c

SuccessfulCreate

Created pod: e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulDelete

Deleted pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 8 to 7

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d66hs

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

ProbeError

Readiness probe error: Get "http://10.132.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

Unhealthy

Readiness probe failed: Get "http://10.132.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulDelete

Deleted pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp
(x2)

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulDelete

Deleted pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96
(x2)

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-4gj96

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 7 to 5
(x2)

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-rfvzp

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-08111b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-08111b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

replicaset-controller

payload-processing-external-model-fdc7999b7

SuccessfulCreate

Created pod: payload-processing-external-model-fdc7999b7-xb26w

models-as-a-service

multus

payload-processing-external-model-fdc7999b7-xb26w

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-fdc7999b7-xb26w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-fdc7999b7-xb26w

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-fdc7999b7-xb26w

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-08111b-openshift-default-5b6dd8787c

SuccessfulCreate

Created pod: e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-08111b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-08111b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-08111b-openshift-default-5b6dd8787c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6958bdd4ff-bhc6f

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-6958bdd4ff

SuccessfulDelete

Deleted pod: payload-processing-external-model-6958bdd4ff-bhc6f
(x4)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6958bdd4ff from 1 to 0

openshift-ingress

multus

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

ProbeError

Startup probe error: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

Unhealthy

Startup probe failed: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-69d95d887d-zpbks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-69d95d887d-zpbks

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-69d95d887d

SuccessfulCreate

Created pod: payload-processing-external-model-69d95d887d-zpbks

models-as-a-service

kubelet

payload-processing-external-model-69d95d887d-zpbks

Started

Container started

models-as-a-service

multus

payload-processing-external-model-69d95d887d-zpbks

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-fdc7999b7

SuccessfulDelete

Deleted pod: payload-processing-external-model-fdc7999b7-xb26w

models-as-a-service

kubelet

payload-processing-external-model-fdc7999b7-xb26w

Killing

Stopping container payload-processing

models-as-a-service

multus

payload-processing-external-model-5546676475-98nhd

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-5546676475

SuccessfulCreate

Created pod: payload-processing-external-model-5546676475-98nhd

models-as-a-service

kubelet

payload-processing-external-model-5546676475-98nhd

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5546676475-98nhd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5546676475-98nhd

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49

SuccessfulCreate

Created pod: e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

openshift-ingress

deployment-controller

e2e-api-a-dd2bbf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-dd2bbf-openshift-default-7fd7f76f49 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-dd2bbf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-dd2bbf

openshift-ingress

multus

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-95hxq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dd2bbf: serviceaccount "payload-processing-e2e-api-a-dd2bbf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-z55dw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-dd2bbf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-dd2bbf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dd2bbf: serviceaccount "payload-processing-e2e-api-a-dd2bbf" not found

openshift-ingress

multus

payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-95hxq

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-95hxq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-z55dw

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-95hxq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-z55dw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-z55dw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-z55dw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-95hxq

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-69d95d887d

SuccessfulDelete

Deleted pod: payload-processing-external-model-69d95d887d-zpbks

models-as-a-service

kubelet

payload-processing-external-model-69d95d887d-zpbks

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-1ec4b892-openshift-default-6c8678f7c

SuccessfulCreate

Created pod: e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

openshift-ingress

deployment-controller

e2e-mt-1ec4b892-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1ec4b892-openshift-default-6c8678f7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-1ec4b892

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-1ec4b892

openshift-ingress

multus

e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1ec4b892-648fc646cf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1ec4b892-648fc646cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1ec4b892: serviceaccount "payload-processing-e2e-mt-1ec4b892" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1ec4b892

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1ec4b892

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1ec4b892-648fc646cf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1ec4b892: serviceaccount "payload-processing-e2e-mt-1ec4b892" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1ec4b892-648fc646cf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulDelete

Deleted pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-775hn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 8 to 7

openshift-ingress

gateway_labeler_controller

e2e-api-b-418af8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-418af8

openshift-ingress

deployment-controller

e2e-api-b-418af8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-418af8-openshift-default-564fb5dc9f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-418af8-openshift-default-564fb5dc9f

SuccessfulCreate

Created pod: e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

openshift-ingress

multus

e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

ProbeError

Readiness probe error: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h566d

Unhealthy

Liveness probe failed: Get "https://10.132.0.41:8000/health": context deadline exceeded

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q6cdk

Unhealthy

Readiness probe failed: Get "https://10.132.0.40:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

Unhealthy

Readiness probe failed: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-xpkhb

Unhealthy

Readiness probe failed: Get "https://10.132.0.39:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-418af8-55df5c84df

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-418af8-55df5c84df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-418af8: serviceaccount "payload-processing-e2e-api-b-418af8" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-418af8-885c454d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-418af8-885c454d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-418af8: serviceaccount "payload-processing-e2e-api-b-418af8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-418af8-885c454d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-418af8-885c454d7-mkx76

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-418af8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-418af8-55df5c84df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-418af8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-418af8-885c454d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-418af8-55df5c84df

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-418af8-55df5c84df-vjqhm

openshift-ingress

kubelet

payload-processing-e2e-api-b-418af8-55df5c84df-vjqhm

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-418af8-55df5c84df-vjqhm

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-418af8-885c454d7-mkx76

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-418af8-55df5c84df-vjqhm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-418af8-885c454d7-mkx76

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-418af8-885c454d7-mkx76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-418af8-55df5c84df-vjqhm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-418af8-885c454d7-mkx76

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8f8aa8-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

openshift-ingress

deployment-controller

e2e-shared-a-w0-8f8aa8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7 from 4 to 3

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-4m57d

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-a-a62d22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a62d22-openshift-default-d9c57bf65 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

Created

Container created

openshift-ingress

multus

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a62d22-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-a62d22-openshift-default-d9c57bf65

SuccessfulCreate

Created pod: e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rzhn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nqkls

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 10 to 9

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-8lgm7
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

Unhealthy

Startup probe failed: Get "http://10.134.0.202:15021/healthz/ready": dial tcp 10.134.0.202:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

ProbeError

Startup probe error: Get "http://10.134.0.202:15021/healthz/ready": dial tcp 10.134.0.202:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-1ec4b892-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1ec4b892-openshift-default-6c8678f7c from 1 to 2
(x2)

openshift-ingress

kubelet

e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1ec4b892-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-mt-1ec4b892-openshift-default-6c8678f7c

SuccessfulCreate

Created pod: e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dd2bbf-68fc6dd7d7-z55dw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

Started

Container started

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-dd2bbf-74fb8cb9c9-95hxq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

Started

Container started

openshift-ingress

multus

e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-dd2bbf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-dd2bbf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

Unhealthy

Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-418af8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

ProbeError

Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-418af8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

ProbeError

Startup probe error: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

Unhealthy

Startup probe failed: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1ec4b892-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1ec4b892-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-dd2bbf-openshift-default-7fd7f76f49-gf5kt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulDelete

Deleted pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-b4qlc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 5 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-418af8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-418af8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-418af8-55df5c84df-vjqhm

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-418af8-885c454d7-mkx76

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-82w8n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 8 to 7
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 9 to 7

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-vx4dt

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-pzj9p

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-zv7lt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-bhq2k

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w0-9add72-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-9add72-openshift-default-c7769bc6c from 10 to 6

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-ggzrq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-nbkv7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1ec4b892-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1ec4b892-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-418af8-openshift-default-564fb5dc9f-l9k97

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-a724a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-a724a6

openshift-ingress

deployment-controller

e2e-shared-a-w2-a724a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a724a6-openshift-default-876f8db6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f

SuccessfulCreate

Created pod: e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulDelete

Deleted pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 7 to 5

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulDelete

Deleted pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulDelete

Deleted pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-qrf2k

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulDelete

Deleted pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-jv6zw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 7 to 5

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lksnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fgd4f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-a724a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a724a6: serviceaccount "payload-processing-e2e-shared-a-w2-a724a6" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a724a6: serviceaccount "payload-processing-e2e-shared-a-w2-a724a6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-a724a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-wkz2r

opendatahub

multus

test-curl-7092-d752f5

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7092-d752f5

Created

Container created

opendatahub

kubelet

test-curl-7092-d752f5

Started

Container started

opendatahub

kubelet

test-curl-7092-d752f5

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7092-d752f5

Killing

Stopping container test-curl-7092-d752f5

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w2-2b8a08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7

SuccessfulCreate

Created pod: e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-2b8a08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-2b8a08

openshift-ingress

multus

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-2b8a08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2b8a08: serviceaccount "payload-processing-e2e-shared-b-w2-2b8a08" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-2b8a08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2b8a08: serviceaccount "payload-processing-e2e-shared-b-w2-2b8a08" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

openshift-ingress

deployment-controller

e2e-shared-b-w0-9add72-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-9add72-openshift-default-c7769bc6c from 6 to 5

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-6z9tv

Killing

Stopping container istio-proxy

models-as-a-service

replicaset-controller

payload-processing-external-model-69d95d887d

SuccessfulCreate

Created pod: payload-processing-external-model-69d95d887d-xsbb2
(x7)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled up replica set payload-processing-external-model-69d95d887d from 0 to 1
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-2qhdm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

multus

payload-processing-external-model-69d95d887d-xsbb2

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-69d95d887d-xsbb2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-d5bzc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-69d95d887d-xsbb2

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-69d95d887d-xsbb2

Started

Container started
(x5)

models-as-a-service

kubelet

payload-processing-external-model-5546676475-98nhd

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-c398a670ca11" not found, secret "agc-cred-e7798d3231e5" not found]
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1ec4b892

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1ec4b892

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1ec4b892-648fc646cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-hxqrb

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1ec4b892-648fc646cf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1ec4b892-648fc646cf-wb6p8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1ec4b892-648fc646cf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1ec4b892-648fc646cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1ec4b892: serviceaccount "payload-processing-e2e-mt-1ec4b892" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1ec4b892: serviceaccount "payload-processing-e2e-mt-1ec4b892" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-hxqrb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-wb6p8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-hxqrb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-hxqrb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-wb6p8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-wb6p8

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-69d95d887d-xsbb2

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5546676475-98nhd

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-hxqrb

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-1ec4b892-648fc646cf-wb6p8

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a724a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-a-c47670-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c47670-openshift-default-7f67b9bfc from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a724a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-c47670

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-c47670

openshift-ingress

replicaset-controller

e2e-extmod-a-c47670-openshift-default-7f67b9bfc

SuccessfulCreate

Created pod: e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

openshift-ingress

multus

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

ProbeError

Startup probe error: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

Unhealthy

Startup probe failed: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-c47670

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-c47670-54c8bb9b89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-c47670

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c47670: serviceaccount "payload-processing-e2e-extmod-a-c47670" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c47670-54c8bb9b89

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c47670-54c8bb9b89

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-c47670-54c8bb9b89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c47670: serviceaccount "payload-processing-e2e-extmod-a-c47670" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn

Created

Container created

opendatahub

kubelet

test-curl-7095-9856f4

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7095-9856f4

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7095-9856f4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn

Started

Container started

opendatahub

kubelet

test-curl-7095-9856f4

Started

Container started

opendatahub

multus

test-curl-7095-d9dfdd

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7095-d9dfdd

Started

Container started

opendatahub

kubelet

test-curl-7095-9856f4

Killing

Stopping container test-curl-7095-9856f4

opendatahub

kubelet

test-curl-7095-d9dfdd

Created

Container created

opendatahub

kubelet

test-curl-7095-d9dfdd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7095-f2afce

Started

Container started

opendatahub

kubelet

test-curl-7095-f2afce

Created

Container created

opendatahub

kubelet

test-curl-7095-f2afce

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7095-f2afce

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7095-d9dfdd

Killing

Stopping container test-curl-7095-d9dfdd

opendatahub

kubelet

test-curl-7095-11eecc

Created

Container created

opendatahub

kubelet

test-curl-7095-11eecc

Started

Container started

opendatahub

kubelet

test-curl-7095-11eecc

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7095-11eecc

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7095-f2afce

Killing

Stopping container test-curl-7095-f2afce

opendatahub

kubelet

test-curl-7095-11eecc

Killing

Stopping container test-curl-7095-11eecc

opendatahub

multus

test-curl-7092-32cedd

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7092-32cedd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7092-32cedd

Created

Container created

opendatahub

kubelet

test-curl-7092-32cedd

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-mt-7e439d04

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7e439d04

openshift-ingress

deployment-controller

e2e-mt-7e439d04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7e439d04-openshift-default-6ff95548d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-7e439d04-openshift-default-6ff95548d9

SuccessfulCreate

Created pod: e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

opendatahub

kubelet

test-curl-7092-32cedd

Killing

Stopping container test-curl-7092-32cedd

openshift-ingress

multus

e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a724a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a724a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2b8a08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2b8a08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7e439d04-588c697959

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7e439d04-588c697959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7e439d04: serviceaccount "payload-processing-e2e-mt-7e439d04" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7e439d04

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7e439d04-588c697959

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7e439d04-588c697959-8dgrg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-jw96h

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7e439d04

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7e439d04-588c697959 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7e439d04: serviceaccount "payload-processing-e2e-mt-7e439d04" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-7e439d04-588c697959-8dgrg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-7e439d04-588c697959-8dgrg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-7e439d04-588c697959-8dgrg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-jw96h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-jw96h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-jw96h

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-7e439d04-588c697959-8dgrg

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-jw96h

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f

SuccessfulCreate

Created pod: e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

openshift-ingress

deployment-controller

e2e-extmod-b-9f71f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-9f71f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-9f71f2

openshift-ingress

multus

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-9f71f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9f71f2: serviceaccount "payload-processing-e2e-extmod-b-9f71f2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-vfxjl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9f71f2: serviceaccount "payload-processing-e2e-extmod-b-9f71f2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-6xt6h

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-9f71f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-6xt6h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-vfxjl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-vfxjl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-vfxjl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-vfxjl

AddedInterface

Add eth0 [10.134.0.225/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-6xt6h

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-6xt6h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-6xt6h

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulDelete

Deleted pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-pgcf8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

AddedInterface

Add eth0 [10.134.0.226/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-146318-openshift-default-85cf4bdd97

SuccessfulCreate

Created pod: e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

openshift-ingress

deployment-controller

e2e-autores-146318-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-146318-openshift-default-85cf4bdd97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-146318

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-146318
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-autores-146318

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-146318-7c785754ff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-146318-7c785754ff

FailedCreate

Error creating: pods "payload-processing-e2e-autores-146318-7c785754ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-146318: serviceaccount "payload-processing-e2e-autores-146318" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-146318-7c785754ff

SuccessfulCreate

Created pod: payload-processing-e2e-autores-146318-7c785754ff-s472g

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-146318-bcd6dd8cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-146318-bcd6dd8cf-mntvr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-146318

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-146318-bcd6dd8cf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-146318-bcd6dd8cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-146318-bcd6dd8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-146318: serviceaccount "payload-processing-e2e-autores-146318" not found

openshift-ingress

multus

payload-processing-e2e-autores-146318-7c785754ff-s472g

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-146318-7c785754ff-s472g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-146318-7c785754ff-s472g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-146318-bcd6dd8cf-mntvr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-146318-bcd6dd8cf-mntvr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-autores-146318-bcd6dd8cf-mntvr

AddedInterface

Add eth0 [10.134.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-146318-bcd6dd8cf-mntvr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-146318-7c785754ff-s472g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

Unhealthy

Startup probe failed: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

ProbeError

Startup probe error: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-1ec4b892-648fc646cf-wb6p8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ec4b892-6b49f5f675-hxqrb

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-mt-1ec4b892-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1ec4b892-openshift-default-6c8678f7c from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1ec4b892-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-1ec4b892-openshift-default-6c8678f7c

SuccessfulCreate

Created pod: e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

openshift-ingress

multus

e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

Started

Container started

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c47670-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-a-w2-a724a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a724a6-openshift-default-876f8db6f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a724a6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c47670-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f

SuccessfulCreate

Created pod: e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

AddedInterface

Add eth0 [10.134.0.229/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2b8a08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2b8a08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

Unhealthy

Startup probe failed: Get "http://10.134.0.229:15021/healthz/ready": dial tcp 10.134.0.229:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

ProbeError

Startup probe error: Get "http://10.134.0.229:15021/healthz/ready": dial tcp 10.134.0.229:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

ProbeError

Readiness probe error: Get "http://10.134.0.224:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-q88k9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

Unhealthy

Readiness probe failed: Get "http://10.134.0.224:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-prh98

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-1ec4b892-openshift-default-6c8678f7c-x24wd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e439d04-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e439d04-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c47670-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c47670-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

ProbeError

Startup probe error: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

Unhealthy

Startup probe failed: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9f71f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9f71f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w2-2b8a08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2b8a08-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7

SuccessfulCreate

Created pod: e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

AddedInterface

Add eth0 [10.134.0.232/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9f71f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9f71f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-146318-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

ProbeError

Startup probe error: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

Unhealthy

Startup probe failed: Get "http://10.134.0.226:15021/healthz/ready": dial tcp 10.134.0.226:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

Unhealthy

Startup probe failed: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

ProbeError

Startup probe error: Get "http://10.134.0.226:15021/healthz/ready": dial tcp 10.134.0.226:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-146318-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e439d04-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e439d04-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-146318-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-146318-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-146318-bcd6dd8cf-mntvr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-146318-7c785754ff-s472g

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 6 to 5

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-autores-146318-openshift-default-85cf4bdd97-gfnwk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-6f33a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-6f33a0

openshift-ingress

replicaset-controller

e2e-explicit-6f33a0-openshift-default-649df665d5

SuccessfulCreate

Created pod: e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

openshift-ingress

deployment-controller

e2e-explicit-6f33a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-6f33a0-openshift-default-649df665d5 from 0 to 1

openshift-ingress

multus

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

Unhealthy

Readiness probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-7e439d04-588c697959-8dgrg

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1a18c8-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-799v6

ProbeError

Readiness probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e439d04-6fbd4dcf47-jw96h

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-extmod-b-1a18c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-1a18c8-openshift-default-67d7b5995c from 3 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c

SuccessfulDelete

Deleted pod: e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-ns6mk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulDelete

Deleted pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-6f33a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-6f33a0-7fc4449fc5 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-6f33a0-7fc4449fc5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-6f33a0-7fc4449fc5-rg4b4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-6f33a0-7fc4449fc5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-6f33a0-7fc4449fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-6f33a0: serviceaccount "payload-processing-e2e-explicit-6f33a0" not found

openshift-ingress

deployment-controller

e2e-shared-a-w0-8f8aa8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8f8aa8-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-csthf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-6f33a0: serviceaccount "payload-processing-e2e-explicit-6f33a0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-5r75g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-6f33a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-6f33a0-7fc4449fc5-rg4b4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-5r75g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-6f33a0-7fc4449fc5-rg4b4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-6f33a0-7fc4449fc5-rg4b4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-5r75g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-6f33a0-7fc4449fc5-rg4b4

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-5r75g

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-5r75g

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d7gxh

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwkwq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 7 to 6

openshift-ingress

deployment-controller

e2e-worker-w4-c381a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-c381a7-openshift-default-78bcd4695 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-c381a7-openshift-default-78bcd4695

SuccessfulDelete

Deleted pod: e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-c381a7-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-6bp78

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e439d04-openshift-default-6ff95548d9-nh4cq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-6f33a0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-6f33a0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-qfc7h

openshift-ingress

deployment-controller

e2e-shared-b-w0-9add72-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-9add72-openshift-default-c7769bc6c from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9add72-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-zzmwf

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2b8a08-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f

SuccessfulCreate

Created pod: e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f

SuccessfulCreate

Created pod: e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

openshift-ingress

deployment-controller

e2e-shared-a-w2-a724a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a724a6-openshift-default-876f8db6f from 2 to 4

openshift-ingress

deployment-controller

e2e-shared-b-w2-2b8a08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7 from 2 to 3

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a724a6-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7

SuccessfulCreate

Created pod: e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

openshift-ingress

multus

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-nhv7l
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

Unhealthy

Readiness probe failed: Get "http://10.132.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

ProbeError

Readiness probe error: Get "http://10.132.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-6f33a0-7dddf5fbf9-5r75g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-6f33a0-7fc4449fc5-rg4b4

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-6f33a0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-6f33a0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f

SuccessfulCreate

Created pod: e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a724a6-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w2-a724a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a724a6-openshift-default-876f8db6f from 4 to 6

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f

SuccessfulCreate

Created pod: e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

Created

Container created

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c381a7-6c77cbc9b7-fdfts

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-noten-cd80b3-openshift-default-8495b6ff6f

SuccessfulCreate

Created pod: e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

openshift-ingress

deployment-controller

e2e-noten-cd80b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-cd80b3-openshift-default-8495b6ff6f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-cd80b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-cd80b3

openshift-ingress

multus

e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

ProbeError

Startup probe error: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

Started

Container started

openshift-ingress

kubelet

e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

Created

Container created

openshift-ingress

kubelet

e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

Unhealthy

Startup probe failed: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

ProbeError

Startup probe error: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

Unhealthy

Startup probe failed: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-6f33a0-openshift-default-649df665d5-rrthx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c381a7-558f76676f-98tbx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-mxk7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-cd80b3-openshift-default-8495b6ff6f-54vxc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-fglkk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-f7dhz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-c381a7-openshift-default-78bcd4695-7tc2j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-z94q6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-7095-d9597e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7095-d9597e

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7095-d9597e

Created

Container created

opendatahub

kubelet

test-curl-7095-d9597e

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-a62d22-openshift-default-d9c57bf65-pvtj7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-7095-4b5732

Created

Container created

opendatahub

kubelet

test-curl-7095-4b5732

Started

Container started

opendatahub

kubelet

test-curl-7095-4b5732

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7095-4b5732

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7095-d9597e

Killing

Stopping container test-curl-7095-d9597e

opendatahub

kubelet

test-curl-7095-4b5732

Killing

Stopping container test-curl-7095-4b5732

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-cf53a4-7db4cb8dd7-ttdzp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-cf53a4-6689d89fbf-9mxzh

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5

SuccessfulDelete

Deleted pod: e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-7d8xg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a4ab8e-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-a4ab8e-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-b-cf53a4-openshift-default-866d74b569-rwx7x

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a62d22-6746df564f-wv77r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a62d22-69fbf9644c-2svhb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-shared-b-w2-2b8a08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7 from 3 to 4

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7

SuccessfulCreate

Created pod: e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2b8a08-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

Created

Container created

openshift-ingress

multus

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d3ca48-8f8dc6499-vkmf4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-d3ca48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-d3ca48-openshift-default-67b76b76f7 from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-d3ca48-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d3ca48-75754d84c9-hj5cs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

openshift-ingress

replicaset-controller

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7

SuccessfulCreate

Created pod: e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

Started

Container started

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc

AddedInterface

Add eth0 [10.134.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

Started

Container started

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

Created

Container created

openshift-ingress

multus

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

AddedInterface

Add eth0 [10.134.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc

Unhealthy

Startup probe failed: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc

ProbeError

Startup probe error: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

ProbeError

Startup probe error: Get "http://10.134.0.254:15021/healthz/ready": dial tcp 10.134.0.254:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

Unhealthy

Startup probe failed: Get "http://10.134.0.254:15021/healthz/ready": dial tcp 10.134.0.254:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v7pkc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-g229x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-v58pm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-rwqbq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-9csnb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-zcfgg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-bpzgk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-mq7ng

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-72rxk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-d3ca48-openshift-default-67b76b76f7-xrw9k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-9tqtj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulDelete

Deleted pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-rsk2s

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 3 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-2cwvx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-cf696

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-pt9kw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-q49zw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

ProbeError

Startup probe error: Get "http://10.134.1.2:15021/healthz/ready": dial tcp 10.134.1.2:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

ProbeError

Readiness probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

ProbeError

Startup probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

Unhealthy

Startup probe failed: Get "http://10.134.1.2:15021/healthz/ready": dial tcp 10.134.1.2:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-tl2n9

Unhealthy

Readiness probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

Unhealthy

Startup probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-a724a6-openshift-default-876f8db6f-qft5h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a724a6-74d7c8885f-ptql9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a724a6-85d5f78fb7-ph7tz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e440bc-openshift-default

SuccessfulRescale

(combined from similar events): New size: 10; reason:
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-e440bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e440bc-openshift-default-d56bb6b89 from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

openshift-ingress

replicaset-controller

e2e-worker-w2-e440bc-openshift-default-d56bb6b89

SuccessfulCreate

Created pod: e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

AddedInterface

Add eth0 [10.134.1.4/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-pznlh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

Unhealthy

Startup probe failed: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

ProbeError

Startup probe error: Get "http://10.134.1.4:15021/healthz/ready": dial tcp 10.134.1.4:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

ProbeError

Startup probe error: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

ProbeError

Startup probe error: Get "http://10.134.1.3:15021/healthz/ready": dial tcp 10.134.1.3:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

Unhealthy

Startup probe failed: Get "http://10.134.1.3:15021/healthz/ready": dial tcp 10.134.1.3:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-jhb8h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

Unhealthy

Startup probe failed: Get "http://10.134.1.4:15021/healthz/ready": dial tcp 10.134.1.4:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

ProbeError

Readiness probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-7h97f

Unhealthy

Readiness probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-2b8a08-openshift-default-77998db5b7-h8779

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2b8a08-7c9fc5b559-mslxz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2b8a08-d76f44b9-6xbbn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-7889g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-ef1693-openshift-default-66b997ddf7-fqzk5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef1693-54fb5894cf-ljzhk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef1693-764b9bdc59-qmhqd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-v2xtv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-1a18c8-openshift-default-67d7b5995c-z4csj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7c192b-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-7c192b-openshift-default-5c496b978f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7c192b-openshift-default-5c496b978f-xznhz
(x3)

openshift-ingress

deployment-controller

e2e-extmod-b-7c192b-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-extmod-b-7c192b-openshift-default-5c496b978f from 3 to 2
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1a18c8-5d757dc685-8vdgh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1a18c8-86d889f759-ql96j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e440bc-85679c9659-sjt9m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e440bc-7b86465fd7-q6p6g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-xsm6n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-zpj4t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-t4h6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-gjjk7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-ckn9r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-2bth5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-lftt4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-h5l5c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-c47670-openshift-default-7f67b9bfc-rv4l7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-hq2g4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e440bc-openshift-default-d56bb6b89-d2rlz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9f71f2-5b8844dc8c-6xt6h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9f71f2-6d44d7746c-vfxjl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c47670-54c8bb9b89-fzdnn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c47670-576b8cbd4c-6p65c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-9f71f2-openshift-default-7bdc6f944f-cqq6x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-jzdqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-8f8aa8-openshift-default-7b6b47ddd7-qs9pq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-84587756dc from 10 to 7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-84587756dc-nr5hn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-nr5hn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-84587756dc-xtsb8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xtsb8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-h2ns8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-84587756dc-h2ns8

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-08111b-744df4c7d7-b5xcs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-08111b-9cc448f95-n6ttb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8f8aa8-bf5f89f4c-9k7qd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8f8aa8-5886b66df7-x64mp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-224r6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-g94p9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-tw9v6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-9add72-openshift-default-c7769bc6c-4w96b

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9add72-67bbb65659-mb9gf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9add72-6b8fc4988f-kxlrl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-v2hw4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-08111b-openshift-default-5b6dd8787c-k4gjf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a4ab8e-68655794c-7c8x7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-ded926-openshift-default-6bdf65b545-pjqfb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ded926-79455f68bc-c64g7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a4ab8e-5fcd9fd57-cnx9p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-wwvqr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-a4ab8e-openshift-default-8645f4b6c5-z7bff

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ded926-5d558d54f5-cwcn2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-jdfb4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-7c192b-openshift-default-5c496b978f-k2fbp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

replicaset-controller

maas-controller-bc865c477

SuccessfulDelete

Deleted pod: maas-controller-bc865c477-6g9s8

opendatahub

kubelet

maas-controller-bc865c477-6g9s8

Killing

Stopping container manager
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7c192b-7c64d44447-mdcqf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7c192b-f6b6648b9-hrvh2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

replicaset-controller

maas-controller-bc865c477

SuccessfulCreate

Created pod: maas-controller-bc865c477-mhwxn

opendatahub

kubelet

maas-controller-bc865c477-mhwxn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02"

opendatahub

multus

maas-controller-bc865c477-mhwxn

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-bc865c477-mhwxn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02" in 1.766s (1.766s including waiting). Image size: 200094742 bytes.

opendatahub

kubelet

maas-controller-bc865c477-mhwxn

Created

Container created

opendatahub

kubelet

maas-controller-bc865c477-mhwxn

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9tb7

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-b9tb7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-92vh9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-zndxf
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-84587756dc from 7 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-84587756dc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-84587756dc-k4c4j

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-k4c4j

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-zndxf

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-84587756dc-92vh9

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

maas-controller-bc865c477-mhwxn_050f2a5a-9dd4-4213-b97c-2d7e55293e53

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-bc865c477-mhwxn_050f2a5a-9dd4-4213-b97c-2d7e55293e53 became leader
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

ProbeError

Startup probe error: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

Unhealthy

Startup probe failed: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

ProbeError

Startup probe error: Get "http://10.132.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

Unhealthy

Startup probe failed: Get "http://10.132.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

replicaset-controller

maas-controller-bc865c477

SuccessfulDelete

Deleted pod: maas-controller-bc865c477-mhwxn
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-bc865c477 from 1 to 0

opendatahub

kubelet

maas-controller-bc865c477-mhwxn

Killing

Stopping container manager
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-bc865c477 from 0 to 1

opendatahub

replicaset-controller

maas-controller-bc865c477

SuccessfulCreate

Created pod: maas-controller-bc865c477-q4c9z

opendatahub

kubelet

maas-controller-bc865c477-q4c9z

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02"

opendatahub

kubelet

maas-controller-bc865c477-q4c9z

Created

Container created

opendatahub

kubelet

maas-controller-bc865c477-q4c9z

Started

Container started

opendatahub

kubelet

maas-controller-bc865c477-q4c9z

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:427f02f0ba66c27164bb06536c88b4a45229432137838a0310640aacd50b7b02" in 408ms (408ms including waiting). Image size: 200094742 bytes.

opendatahub

multus

maas-controller-bc865c477-q4c9z

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

opendatahub

maas-controller-bc865c477-q4c9z_f1e367c1-541f-4746-8400-8ffc4deb01e0

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-bc865c477-q4c9z_f1e367c1-541f-4746-8400-8ffc4deb01e0 became leader

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-bsvp9

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-bsvp9

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-gpqgh

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-gpqgh

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-gpqgh

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-gpqgh

Created

Container created
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-gpqgh

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-gpqgh_0e260305-d50e-4f8c-b995-c3177adb17bf

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-gpqgh_0e260305-d50e-4f8c-b995-c3177adb17bf became leader

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-dvwqs

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-dvwqs

openshift-ingress

replicaset-controller

e2e-ait-d969013e-openshift-default-6ff77f8c6c

SuccessfulCreate

Created pod: e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

openshift-ingress

deployment-controller

e2e-ait-d969013e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d969013e-openshift-default-6ff77f8c6c from 0 to 1

openshift-ingress

multus

e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-d969013e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d969013e

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d969013e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d969013e-69795cd9c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-d969013e-69795cd9c-fpcj9

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d969013e-69795cd9c-fpcj9

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d969013e-69795cd9c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d969013e-69795cd9c-fpcj9

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d969013e-85c7895599-g4z9h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d969013e-85c7895599-g4z9h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-d969013e-69795cd9c-fpcj9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-d969013e-69795cd9c-fpcj9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d969013e-85c7895599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d969013e-85c7895599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d969013e: serviceaccount "payload-processing-e2e-ait-d969013e" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-d969013e-85c7895599-g4z9h

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d969013e-85c7895599-g4z9h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d969013e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d969013e-85c7895599 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d969013e-69795cd9c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d969013e-69795cd9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d969013e: serviceaccount "payload-processing-e2e-ait-d969013e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d969013e-85c7895599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d969013e-85c7895599-g4z9h

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-d969013e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-d969013e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d969013e-85c7895599-g4z9h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d969013e-69795cd9c-fpcj9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-d969013e-openshift-default-6ff77f8c6c-cl26n

Killing

Stopping container istio-proxy

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.Service llm/e2e-prio-pool-d2dab122-kserve-workload-svc

llm

replicaset-controller

e2e-prio-pool-d2dab122-kserve-58bf7b4f87

SuccessfulCreate

Created pod: e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.Role llm/e2e-prio-pool-d2dab122-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.RoleBinding llm/e2e-prio-pool-d2dab122-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.Deployment llm/e2e-prio-pool-d2dab122-kserve-router-scheduler

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.Service llm/e2e-prio-pool-d2dab122-epp-service

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-d2dab122-epp-auth-rb

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.ServiceAccount llm/e2e-prio-pool-d2dab122-epp-sa

llm

deployment-controller

e2e-prio-pool-d2dab122-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.Deployment llm/e2e-prio-pool-d2dab122-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

Created v1.Secret llm/e2e-prio-pool-d2dab122-kserve-self-signed-certs

llm

deployment-controller

e2e-prio-pool-d2dab122-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-d2dab122-kserve-58bf7b4f87 from 0 to 1

llm

replicaset-controller

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb

SuccessfulCreate

Created pod: e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-d2dab122-kserve-shadow-svc

llm

multus

e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-d2dab122-kserve-route

llm

kubelet

e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b

Created

Container created

llm

kubelet

e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b

Started

Container started

llm

multus

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Updated

Updated v1.Secret llm/e2e-prio-pool-d2dab122-kserve-self-signed-certs

llm

kubelet

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

Created

Container created

llm

kubelet

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

Started

Container started

llm

kubelet

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 4.249s (4.249s including waiting). Image size: 184206420 bytes.

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-d2dab122] is Ready

llm

LLMInferenceServiceController

e2e-prio-pool-d2dab122

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-d2dab122-epp-auth-rb

llm

kubelet

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b

Killing

Stopping container main
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-5v6m6

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-mnk7k

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

e2e-prio-pool-d2dab122-kserve-58bf7b4f87-jjs6b

Unhealthy

Readiness probe failed: Get "https://10.132.0.199:8000/ready": context deadline exceeded

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Created

Created v1.DestinationRule llm/e2e-same-id-a-6a354560-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Created

Created v1.Deployment llm/e2e-same-id-a-6a354560-kserve

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-6a354560-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Created

Created v1.PodMonitor llm/e2e-same-id-a-6a354560-kserve-llmisvc-engine

llm

replicaset-controller

e2e-same-id-a-6a354560-kserve-58644b47cc

SuccessfulCreate

Created pod: e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q

llm

deployment-controller

e2e-same-id-a-6a354560-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-6a354560-kserve-58644b47cc from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Created

Created v1.Secret llm/e2e-same-id-a-6a354560-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Created

Created v1.PodMonitor llm/e2e-same-id-a-6a354560-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Created

Created v1.Service llm/e2e-same-id-a-6a354560-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Created

Created v1.HTTPRoute llm/e2e-same-id-a-6a354560-kserve-route

llm

kubelet

e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q

Started

Container started

llm

kubelet

e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q

Created

Container created

llm

multus

e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q

AddedInterface

Add eth0 [10.134.1.20/23] from ovn-kubernetes
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

Updated

Updated v1.Secret llm/e2e-same-id-a-6a354560-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-6a354560] is Ready

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Created

Created v1.Service llm/e2e-same-id-b-6a354560-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Created

Created v1.HTTPRoute llm/e2e-same-id-b-6a354560-kserve-route

llm

kubelet

e2e-same-id-b-6a354560-kserve-69687b969c-bgqb7

Created

Container created

llm

kubelet

e2e-same-id-b-6a354560-kserve-69687b969c-bgqb7

Started

Container started

llm

replicaset-controller

e2e-same-id-b-6a354560-kserve-69687b969c

SuccessfulCreate

Created pod: e2e-same-id-b-6a354560-kserve-69687b969c-bgqb7

llm

deployment-controller

e2e-same-id-b-6a354560-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-6a354560-kserve-69687b969c from 0 to 1

llm

kubelet

e2e-same-id-b-6a354560-kserve-69687b969c-bgqb7

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Created

Created v1.Secret llm/e2e-same-id-b-6a354560-kserve-self-signed-certs

llm

multus

e2e-same-id-b-6a354560-kserve-69687b969c-bgqb7

AddedInterface

Add eth0 [10.134.1.21/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Created

Created v1.Deployment llm/e2e-same-id-b-6a354560-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Created

Created v1.DestinationRule llm/e2e-same-id-b-6a354560-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Created

Created v1.PodMonitor llm/e2e-same-id-b-6a354560-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Created

Created v1.PodMonitor llm/e2e-same-id-b-6a354560-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-6a354560-prometheus-scraping
(x4)

llm

kubelet

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

Updated

Updated v1.Secret llm/e2e-same-id-b-6a354560-kserve-self-signed-certs

llm

kubelet

e2e-prio-pool-d2dab122-kserve-router-scheduler-f5cfb7bb-b225h

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.200:9003" within 1s: context deadline exceeded

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-6a354560] is Ready
(x3)

llm

LLMInferenceServiceController

e2e-same-id-a-6a354560

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-6a354560 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-6a354560; safe to ignore if traffic splitting is planned
(x7)

llm

LLMInferenceServiceController

e2e-same-id-b-6a354560

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-6a354560 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-6a354560; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-6a354560-kserve-69687b969c-bgqb7

Killing

Stopping container main

llm

kubelet

e2e-same-id-a-6a354560-kserve-58644b47cc-shk6q

Unhealthy

Readiness probe failed: Get "https://10.134.1.20:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d0441c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d0441c

openshift-ingress

deployment-controller

e2e-ipp-a-d0441c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d0441c-openshift-default-d67bc796c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-d0441c-openshift-default-d67bc796c

SuccessfulCreate

Created pod: e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

openshift-ingress

multus

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d0441c: serviceaccount "payload-processing-e2e-ipp-a-d0441c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-t76cc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d0441c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d0441c-5678568b5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d0441c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d0441c-5678568b5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d0441c-5678568b5-zwjch
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d0441c-5678568b5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d0441c-5678568b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d0441c: serviceaccount "payload-processing-e2e-ipp-a-d0441c" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-t76cc

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-t76cc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-5678568b5-zwjch

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-d0441c-5678568b5-zwjch

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-t76cc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-t76cc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-5678568b5-zwjch

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-5678568b5-zwjch

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

Unhealthy

Readiness probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

ProbeError

Readiness probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-5678568b5-zwjch

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-54cccc9767-t76cc

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d0441c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d0441c-7776b4999d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d0441c: serviceaccount "payload-processing-e2e-ipp-a-d0441c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d0441c-7776b4999d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d0441c-7776b4999d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d0441c: serviceaccount "payload-processing-e2e-ipp-a-d0441c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d0441c-7776b4999d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d0441c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.559s (2.559s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.521s (2.521s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-4d1115

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-4d1115

openshift-ingress

deployment-controller

e2e-ipp-b-4d1115-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-4d1115-openshift-default-59d4f94977 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-4d1115-openshift-default-59d4f94977

SuccessfulCreate

Created pod: e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

openshift-ingress

multus

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-4d1115

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-4d1115-8b4cdc999 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-4d1115

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4d1115: serviceaccount "payload-processing-e2e-ipp-b-4d1115" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-4xldn
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4d1115-8b4cdc999

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-4d1115-8b4cdc999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4d1115: serviceaccount "payload-processing-e2e-ipp-b-4d1115" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4d1115-8b4cdc999

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-4d1115-8b4cdc999-vj6xh

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4d1115-8b4cdc999-vj6xh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-4xldn

AddedInterface

Add eth0 [10.134.1.23/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4d1115-8b4cdc999-vj6xh

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d0441c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-4xldn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-4xldn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-4xldn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d0441c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4d1115-8b4cdc999-vj6xh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-4d1115-8b4cdc999-vj6xh

AddedInterface

Add eth0 [10.134.1.22/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-4d1115-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-4d1115-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4d1115-8b4cdc999-vj6xh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4d1115-86bc9c8975-4xldn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

ProbeError

Readiness probe error: Get "http://10.132.0.210:15021/healthz/ready": read tcp 10.132.0.2:47184->10.132.0.210:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

Unhealthy

Readiness probe failed: Get "http://10.132.0.210:15021/healthz/ready": read tcp 10.132.0.2:47184->10.132.0.210:15021: read: connection reset by peer

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4d1115-578bff4f88

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-4d1115-578bff4f88-fb7gg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4d1115-578bff4f88

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-4d1115-578bff4f88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4d1115: serviceaccount "payload-processing-e2e-ipp-b-4d1115" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-4d1115

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-4d1115-578bff4f88 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-4d1115

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-8vqz6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4d1115: serviceaccount "payload-processing-e2e-ipp-b-4d1115" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-8vqz6

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4d1115-578bff4f88-fb7gg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4d1115-578bff4f88-fb7gg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4d1115-578bff4f88-fb7gg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-8vqz6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-8vqz6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-8vqz6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-4d1115-578bff4f88-fb7gg

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-4d1115-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-4d1115-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0441c-7776b4999d-6kzsf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0441c-66875c8bc9-tw57h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-d0441c-openshift-default-d67bc796c-57tvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4d1115-7fc4d545cf-8vqz6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4d1115-578bff4f88-fb7gg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-5b44f68b67-gwbxk

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-5b44f68b67 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-5b44f68b67-gwbxk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-5b44f68b67-gwbxk

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-5b44f68b67-gwbxk

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-5b44f68b67

SuccessfulCreate

Created pod: payload-pre-processing-5b44f68b67-gwbxk

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-4d1115-openshift-default-59d4f94977-rmjd7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-p9ckq

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-p9ckq

openshift-ingress

replicaset-controller

payload-processing-74d765fb54

SuccessfulCreate

Created pod: payload-processing-74d765fb54-fcczn

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-74d765fb54 from 0 to 1

openshift-ingress

kubelet

payload-processing-74d765fb54-fcczn

Started

Container started

openshift-ingress

kubelet

payload-processing-74d765fb54-fcczn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-74d765fb54-fcczn

Created

Container created

openshift-ingress

multus

payload-processing-74d765fb54-fcczn

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-khw76

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-khw76

openshift-ingress

replicaset-controller

payload-processing-776d6d99b

SuccessfulCreate

Created pod: payload-processing-776d6d99b-q7jqc

openshift-ingress

replicaset-controller

payload-pre-processing-67f556869f

SuccessfulCreate

Created pod: payload-pre-processing-67f556869f-kv4cs

openshift-ingress

multus

payload-processing-776d6d99b-q7jqc

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-67f556869f from 0 to 1

openshift-ingress

kubelet

payload-processing-776d6d99b-q7jqc

Created

Container created

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-776d6d99b from 0 to 1

openshift-ingress

kubelet

payload-processing-776d6d99b-q7jqc

Started

Container started

openshift-ingress

kubelet

payload-processing-776d6d99b-q7jqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-67f556869f-kv4cs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-67f556869f-kv4cs

Created

Container created

openshift-ingress

multus

payload-pre-processing-67f556869f-kv4cs

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-67f556869f-kv4cs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-5b44f68b67

SuccessfulDelete

Deleted pod: payload-pre-processing-5b44f68b67-gwbxk

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-74d765fb54 from 1 to 0

openshift-ingress

replicaset-controller

payload-processing-74d765fb54

SuccessfulDelete

Deleted pod: payload-processing-74d765fb54-fcczn

openshift-ingress

kubelet

payload-pre-processing-5b44f68b67-gwbxk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-74d765fb54-fcczn

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-5b44f68b67 from 1 to 0
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

multus

payload-processing-external-model-5bcd7997-h56sp

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-h56sp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-h56sp

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-h56sp

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-h56sp

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-h56sp

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-vrbqc

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-vrbqc

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-single-main-64455b-openshift-default-6477df7745

SuccessfulCreate

Created pod: e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-64455b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-64455b

openshift-ingress

deployment-controller

e2e-worker-single-main-64455b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-64455b-openshift-default-6477df7745 from 0 to 1

openshift-ingress

multus

e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-64455b: serviceaccount "payload-processing-e2e-worker-single-main-64455b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-64455b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-64455b-6d498984c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-64455b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-64455b-6d498984c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-64455b-6d498984c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-64455b: serviceaccount "payload-processing-e2e-worker-single-main-64455b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-64455b-6d498984c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-64455b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-64455b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498qmg7d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5f7stz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-64455b-6d498984c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-64455b-6d498zdbkw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-64455b-6d498984c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-64455b-6d498984c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-64455b: serviceaccount "payload-processing-e2e-worker-single-main-64455b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-64455b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-64455b-6d498984c9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-64455b: serviceaccount "payload-processing-e2e-worker-single-main-64455b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5xbjdl

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-64455b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498zdbkw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-64455b-6d498zdbkw

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5xbjdl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498zdbkw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5xbjdl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5xbjdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498zdbkw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5xbjdl

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-64455b-b6c5ff7c5xbjdl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-64455b-6d498zdbkw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-64455b-openshift-default-6477df7745pk7lm

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xs5rk

Unhealthy

Readiness probe failed: Get "http://10.134.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-xs5rk

ProbeError

Readiness probe error: Get "http://10.134.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-tb9j4

Unhealthy

Readiness probe failed: Get "http://10.134.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-tb9j4

ProbeError

Readiness probe error: Get "http://10.134.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-sl776

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-sl776

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

ProbeError

Readiness probe error: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

Unhealthy

Readiness probe failed: Get "http://10.132.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

ProbeError

Readiness probe error: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-92vh9

ProbeError

Readiness probe error: Get "http://10.132.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-zndxf

Unhealthy

Readiness probe failed: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-84587756dc-k4c4j

Unhealthy

Readiness probe failed: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)