Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw to ip-10-0-143-27.ec2.internal

ai-tenants

e2e-api-a-b273b6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-b273b6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-c93367

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-c93367: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-2818a6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-2818a6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-356082

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-356082: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-b2c11f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-b2c11f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-c2993e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-c2993e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-a1028d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-a1028d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-9bf0e2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-9bf0e2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-0ce950

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-0ce950: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-58fad4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-58fad4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-6b8bfa

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-6b8bfa: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-95f40f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-95f40f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-a0fc73

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-a0fc73: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-000edd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-000edd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-0fdc4e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-0fdc4e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-2c4b44

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-2c4b44: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-93ec46

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-93ec46: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-9dfb3c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-9dfb3c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-1fddb7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-1fddb7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-2943ff

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-2943ff: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-3d5da6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-3d5da6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-52d131

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-52d131: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-db01c4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-db01c4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-07fb25

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-07fb25: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-4593af

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-4593af: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-c75203

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-c75203: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-d207e8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-d207e8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-d97e4c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-d97e4c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-168989

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-168989: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-5c90f5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-5c90f5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-7542fa

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-7542fa: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-954773

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-954773: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-bd098e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-bd098e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-0f3cd8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-0f3cd8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-145336

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-145336: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-38bc0d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-38bc0d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-6ba1d9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-6ba1d9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-86dd79

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-86dd79: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-2933ff00

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-2933ff00: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-edae4317

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-edae4317: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-2979be

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-2979be: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-428529

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-428529: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-70a069

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-70a069: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-95daa2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-95daa2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-003ec6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-003ec6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-3ad281

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-3ad281: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-b4a561

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-b4a561: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-ea4bc0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-ea4bc0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-2819d2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-2819d2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-3a00b8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-3a00b8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-584ec5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-584ec5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-24fb97

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-24fb97: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-4153e5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-4153e5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-9a1cd0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-9a1cd0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-a0684f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-a0684f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-01a9cd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-01a9cd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-594253

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-594253: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-17e747

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-17e747: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-single-main-447d90

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-single-main-447d90: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-single-main-88fa81

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-single-main-88fa81: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-c40a89

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-c40a89: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-f6f4f0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-f6f4f0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-719029

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-719029: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-78d5ff

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-78d5ff: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-b93d51

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-b93d51: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-b27jr

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-b27jr to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-v52zs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-v52zs to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-edae4317-8477bbf575-tjdfg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-edae4317-8477bbf575-tjdfg to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-428529-8679b59df9-4nfl5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-428529-8679b59df9-4nfl5 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-cjrm2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-cjrm2 to ip-10-0-143-27.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-f8g6j

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-f8g6j to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-x2h5b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-x2h5b to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-n8t27

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-n8t27 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-9tdgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-9tdgg to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-h5vlz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-h5vlz to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999 to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-mz5mb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-mz5mb to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc to ip-10-0-143-27.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-8pws6

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-8pws6 to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-cg5r9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-cg5r9 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25 to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-25wf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-25wf9 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj to ip-10-0-142-110.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-z7ctn

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-z7ctn to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-cqsmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-cqsmb to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j to ip-10-0-130-0.ec2.internal

kuadrant-system

authorino-57f7f8659f-wtxbc

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-wtxbc to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-jl8hl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-jl8hl to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-719029-66c86885dc-klbw6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-719029-66c86885dc-klbw6 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-56f8ccc945-54crd

Scheduled

Successfully assigned openshift-ingress/payload-processing-56f8ccc945-54crd to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-qfc9q

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-qfc9q to ip-10-0-143-27.ec2.internal

kuadrant-system

authorino-59cdc7947-244dk

Scheduled

Successfully assigned kuadrant-system/authorino-59cdc7947-244dk to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-75c985bd9-6thmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-75c985bd9-6thmd to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ait-14b53b75-66cd655bd8-rqk8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-14b53b75-66cd655bd8-rqk8z to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-ait-61b6469a-d856545d4-2z75s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-61b6469a-d856545d4-2z75s to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a0944980-7f77d8bd9b-t6tkk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a0944980-7f77d8bd9b-t6tkk to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ait-bc6b04f0-857d8b75bd-bcvpw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-bc6b04f0-857d8b75bd-bcvpw to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-2198e4-585bd74748-5sfg7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2198e4-585bd74748-5sfg7 to ip-10-0-142-110.ec2.internal

kuadrant-system

authorino-6889cbd8c4-w8xm8

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-w8xm8 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-4874l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-4874l to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh to ip-10-0-130-0.ec2.internal

kuadrant-system

authorino-6f6944bcdd-bzgvb

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-bzgvb to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-q6l9v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-q6l9v to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-dv8mp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-dv8mp to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-4d925

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-4d925 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-145336-755cc54c67-gdp9j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-145336-755cc54c67-gdp9j to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-145336-547c679c5-t8nvr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-145336-547c679c5-t8nvr to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-922b2c-66bf787d66-msht8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-922b2c-66bf787d66-msht8 to ip-10-0-143-27.ec2.internal

kuadrant-system

authorino-7795bf7868-gmhpg

Scheduled

Successfully assigned kuadrant-system/authorino-7795bf7868-gmhpg to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-kbs5c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-kbs5c to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-xqjsc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-xqjsc to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-2drtb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-2drtb to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf to ip-10-0-142-110.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-45k2d

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-45k2d to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-kpldt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-kpldt to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-954773-6b46c87747-zb7xx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-954773-6b46c87747-zb7xx to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-b273b6-6bcd8bb886-4mhbb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b273b6-6bcd8bb886-4mhbb to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n to ip-10-0-143-27.ec2.internal

ai-tenants

e2e-api-a-2198e4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-2198e4: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-zzn9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-zzn9d to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-mvdkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-mvdkm to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c93367-6666bff5bd-8pcq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c93367-6666bff5bd-8pcq4 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-168989-57776d77b7-zzmrl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-168989-57776d77b7-zzmrl to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-n85cs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-n85cs to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-2818a6-6fc6bff7c6-vx86g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2818a6-6fc6bff7c6-vx86g to ip-10-0-143-27.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-z4b6g

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-z4b6g to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-4q2rj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-4q2rj to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-356082-84fd4794fb-578fh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-356082-84fd4794fb-578fh to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7 to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64 to ip-10-0-143-27.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-8fhqf

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-8fhqf to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b2c11f-777dbfbc54-n2jtr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b2c11f-777dbfbc54-n2jtr to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-g88g6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-g88g6 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-d99vq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-d99vq to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-a1028d-5747ccb875-vxckc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-a1028d-5747ccb875-vxckc to ip-10-0-142-110.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-rjj9l

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rjj9l to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8 to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74 to ip-10-0-142-110.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-s228v

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s228v to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-j4vvf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-j4vvf to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-autores-a1028d-7f6d45d596-c5x65

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-a1028d-7f6d45d596-c5x65 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-derive-6c3505dc-68c5ff6c98-qgtfj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6c3505dc-68c5ff6c98-qgtfj to ip-10-0-142-110.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-w5pkt

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-w5pkt to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-9bf0e2-7dd576c498-rlxz6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-9bf0e2-7dd576c498-rlxz6 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-mh9c9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-mh9c9 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-2c4b44-76d85598d-jznf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2c4b44-76d85598d-jznf4 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv to ip-10-0-142-110.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-vz5pc

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-vz5pc to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-vxwlv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-vxwlv to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-db01c4-5bd4b7f956-7nkt6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-db01c4-5bd4b7f956-7nkt6 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-rcfwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-rcfwp to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp to ip-10-0-143-27.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-p2m8w

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-p2m8w to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d207e8-597bf6d8c4-trvfs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d207e8-597bf6d8c4-trvfs to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-168989-5cfc8db7cd-t522n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-168989-5cfc8db7cd-t522n to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-168989-7495c56bd-gpdbf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-168989-7495c56bd-gpdbf to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-zft8k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-zft8k to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-356082-6f945d9cbc-w4tbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-356082-6f945d9cbc-w4tbx to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc to ip-10-0-142-110.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-57dvj

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-57dvj to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2818a6-586fb4d987-bvv67

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2818a6-586fb4d987-bvv67 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c93367-967fd786c-r7vg5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c93367-967fd786c-r7vg5 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-5c90f5-74b8894498-hx8v8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5c90f5-74b8894498-hx8v8 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-vp85w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-vp85w to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7542fa-56c9884798-4vnfc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7542fa-56c9884798-4vnfc to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67 to ip-10-0-130-0.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-8mxxx

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-8mxxx to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7542fa-5fff779d4-p5p5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7542fa-5fff779d4-p5p5g to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw to ip-10-0-130-0.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-srspl

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-srspl to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-954773-5974987546-jmjmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-954773-5974987546-jmjmm to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-954773-c8cc8fb7b-kxfjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-954773-c8cc8fb7b-kxfjn to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2 to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-qrbgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-qrbgc to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-45f4s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-45f4s to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-llfjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-llfjt to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

Scheduled

Successfully assigned openshift-ingress/e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bd098e-676766d5fb-lfkpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bd098e-676766d5fb-lfkpd to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5 to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv to ip-10-0-143-27.ec2.internal

ai-tenants

e2e-api-a-922b2c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-922b2c: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-lxtlt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lxtlt to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-zb98v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-zb98v to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-pre-processing-8dd7b7cc5-ngv24

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-8dd7b7cc5-ngv24 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-7bf6df7cf-qcpgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7bf6df7cf-qcpgl to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-xsvkx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-xsvkx to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6 to ip-10-0-143-27.ec2.internal

opendatahub

ai-gateway-controller-67f4f4fc68-mtts8

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-67f4f4fc68-mtts8 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr to ip-10-0-143-27.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-zr7w4

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-zr7w4 to ip-10-0-130-0.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-wptrw

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-wptrw to ip-10-0-130-0.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-w7p7b

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-w7p7b to ip-10-0-130-0.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-5cf4665f7f-8ml9q

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cf4665f7f-8ml9q to ip-10-0-130-0.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-4dsxw

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-4dsxw to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-api-b-356082-openshift-default-7dd6879f-cf82h

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-356082-openshift-default-7dd6879f-cf82h to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9 to ip-10-0-142-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-zvgvw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zvgvw to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-zghmk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zghmk to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-ssskh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ssskh to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-sdrx5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-sdrx5 to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-rt6p2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rt6p2 to ip-10-0-142-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-rgk4t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-rgk4t to ip-10-0-143-27.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-ppvtr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-ppvtr to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4 to ip-10-0-143-27.ec2.internal

llm

e2e-prio-pool-8b3c5a4d-kserve-fd74466b5-wjrgx

Scheduled

Successfully assigned llm/e2e-prio-pool-8b3c5a4d-kserve-fd74466b5-wjrgx to ip-10-0-142-110.ec2.internal

opendatahub

maas-controller-6579864b68-5hcbw

Scheduled

Successfully assigned opendatahub/maas-controller-6579864b68-5hcbw to ip-10-0-143-27.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-25r9k

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-25r9k to ip-10-0-130-0.ec2.internal

opendatahub

maas-controller-75b4575b56-4865l

Scheduled

Successfully assigned opendatahub/maas-controller-75b4575b56-4865l to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5 to ip-10-0-142-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-nzg5g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-nzg5g to ip-10-0-143-27.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-nw522

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-nw522 to ip-10-0-143-27.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-mzxsn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-mzxsn to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm to ip-10-0-142-110.ec2.internal

llm

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

Scheduled

Successfully assigned llm/e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6 to ip-10-0-143-27.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-m9q2m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-m9q2m to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7 to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-kf6tq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-kf6tq to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-jhqft

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-jhqft to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76 to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-gjlm2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-gjlm2 to ip-10-0-142-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-g55b2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-g55b2 to ip-10-0-142-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-fpsp7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-fpsp7 to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv to ip-10-0-142-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-fl6gr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-fl6gr to ip-10-0-143-27.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-bwczm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-bwczm to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-b95w4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-b95w4 to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-9stc4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-9stc4 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-8tg6k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-8tg6k to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-wgcm7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-wgcm7 to ip-10-0-143-27.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-8pw9h

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-8pw9h to ip-10-0-142-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-72kzd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-72kzd to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-5htrm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-5htrm to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn to ip-10-0-142-110.ec2.internal

llm

e2e-same-id-a-50b514ff-kserve-5cbd7cb68f-bkfsn

Scheduled

Successfully assigned llm/e2e-same-id-a-50b514ff-kserve-5cbd7cb68f-bkfsn to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5 to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-57s4v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-57s4v to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-4spcb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-4spcb to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg to ip-10-0-143-27.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-46t2r

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-46t2r to ip-10-0-142-110.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-2wbd7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-2wbd7 to ip-10-0-142-110.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-6kg7d

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-6kg7d to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-2qvfs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-2qvfs to ip-10-0-130-0.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-75d7c785f-28ssd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-28ssd to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488 to ip-10-0-143-27.ec2.internal

openshift-ingress

kube-auth-proxy-7bd6fc9ff9-w5zwp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7bd6fc9ff9-w5zwp to ip-10-0-130-0.ec2.internal

openshift-ingress

kube-auth-proxy-7bd6fc9ff9-m9zg8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7bd6fc9ff9-m9zg8 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str to ip-10-0-130-0.ec2.internal

llm

e2e-same-id-a-50b514ff

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-50b514ff

llm

e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5

Scheduled

Successfully assigned llm/e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5 to ip-10-0-142-110.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-xr74l

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xr74l to ip-10-0-142-110.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-sc85c

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sc85c to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck to ip-10-0-142-110.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bt6gz to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8 to ip-10-0-130-0.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-5vjwt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5vjwt to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv to ip-10-0-142-110.ec2.internal

openshift-jobset-operator

jobset-controller-manager-5c89ff7c87-fpdp6

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-5c89ff7c87-fpdp6 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct to ip-10-0-143-27.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-9fjjh

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-9fjjh to ip-10-0-130-0.ec2.internal

models-as-a-service

payload-processing-external-model-96b798988-vwbd2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-96b798988-vwbd2 to ip-10-0-142-110.ec2.internal

opendatahub

odh-model-controller-769875db56-kpkmz

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-kpkmz to ip-10-0-130-0.ec2.internal

opendatahub

test-curl-11184-01ba9d

Scheduled

Successfully assigned opendatahub/test-curl-11184-01ba9d to ip-10-0-142-110.ec2.internal

llm

e2e-same-id-b-50b514ff

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-50b514ff

llm

e2e-same-id-b-50b514ff

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-v5zns

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-v5zns to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9 to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-wxn5z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-wxn5z to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-rn9ld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-rn9ld to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-zks77

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-zks77 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-145336-5f79ffd9c4-z2vbr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-145336-5f79ffd9c4-z2vbr to ip-10-0-142-110.ec2.internal

models-as-a-service

payload-processing-external-model-7d7446f96-dg6pw

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7d7446f96-dg6pw to ip-10-0-143-27.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-2gzsp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-2gzsp to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-145336-7dbd64fd96-hb742

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-145336-7dbd64fd96-hb742 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-wd9mn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-wd9mn to ip-10-0-143-27.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82qnb6

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82qnb6 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

Scheduled

Successfully assigned openshift-ingress/e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9 to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-ng4qf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-ng4qf to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87 to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-4djss

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-4djss to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w to ip-10-0-130-0.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-dw8g7

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-dw8g7 to ip-10-0-142-110.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4 to ip-10-0-143-27.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-84d4d45d7c5mcwv

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-84d4d45d7c5mcwv to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6ba1d9-dd777b898-2fzph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6ba1d9-dd777b898-2fzph to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-b4a561-5c6655468-48jfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b4a561-5c6655468-48jfm to ip-10-0-143-27.ec2.internal

opendatahub

maas-controller-75b4575b56-7wgng

Scheduled

Successfully assigned opendatahub/maas-controller-75b4575b56-7wgng to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-xls4z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-xls4z to ip-10-0-142-110.ec2.internal

opendatahub

maas-controller-75b4575b56-vfzpw

Scheduled

Successfully assigned opendatahub/maas-controller-75b4575b56-vfzpw to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-m47lr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-m47lr to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-95daa2-56c855c684-r75r9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-95daa2-56c855c684-r75r9 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-70a069-588bb4c774-k8f7k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-70a069-588bb4c774-k8f7k to ip-10-0-142-110.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-pd2tp

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-pd2tp to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-428529-6b49dc7d56-9nrst

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-428529-6b49dc7d56-9nrst to ip-10-0-142-110.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-66dfc65cbf-zns6d to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-mt-edae4317-69d497b588-dhfts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-edae4317-69d497b588-dhfts to ip-10-0-143-27.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-66dfc65cbf-dw6pk to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx to ip-10-0-130-0.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-cpmfd

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cpmfd to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt to ip-10-0-130-0.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-66dfc65cbf-d4r4z to ip-10-0-130-0.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-6sv2d

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6sv2d to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm to ip-10-0-130-0.ec2.internal

opendatahub

test-curl-11196-bc3f78

Scheduled

Successfully assigned opendatahub/test-curl-11196-bc3f78 to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-rgsbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-rgsbw to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8 to ip-10-0-142-110.ec2.internal

opendatahub

test-curl-11196-6de19d

Scheduled

Successfully assigned opendatahub/test-curl-11196-6de19d to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q to ip-10-0-130-0.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj to ip-10-0-142-110.ec2.internal

opendatahub

test-curl-11196-532d8a

Scheduled

Successfully assigned opendatahub/test-curl-11196-532d8a to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-86dd79-975c67ddd-9fkvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-86dd79-975c67ddd-9fkvs to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-5p677 to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr to ip-10-0-143-27.ec2.internal

opendatahub

test-curl-11196-456950

Scheduled

Successfully assigned opendatahub/test-curl-11196-456950 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh to ip-10-0-142-110.ec2.internal

opendatahub

test-curl-11196-01ba21

Scheduled

Successfully assigned opendatahub/test-curl-11196-01ba21 to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7664a237-577f9d5b4-kzhqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7664a237-577f9d5b4-kzhqr to ip-10-0-143-27.ec2.internal

opendatahub

test-curl-11190-2f177e

Scheduled

Successfully assigned opendatahub/test-curl-11190-2f177e to ip-10-0-130-0.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2933ff00-7574c49c54-nnhq8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2933ff00-7574c49c54-nnhq8 to ip-10-0-142-110.ec2.internal

opendatahub

test-curl-11187-b5249c

Scheduled

Successfully assigned opendatahub/test-curl-11187-b5249c to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d to ip-10-0-142-110.ec2.internal

models-as-a-service

payload-processing-external-model-565954b4c8-xdflc

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-565954b4c8-xdflc to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7 to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-719029-68f6795878-p8vdz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-719029-68f6795878-p8vdz to ip-10-0-142-110.ec2.internal

openshift-ingress

router-default-75f7cfffd5-4l7bn

Scheduled

Successfully assigned openshift-ingress/router-default-75f7cfffd5-4l7bn to ip-10-0-142-110.ec2.internal

openshift-ingress

router-default-75f7cfffd5-4l7bn

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-75f7cfffd5-4l7bn

FailedScheduling

no nodes available to schedule pods

models-as-a-service

payload-processing-external-model-574c95cfc5-p2vlp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-574c95cfc5-p2vlp to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv to ip-10-0-142-110.ec2.internal

opendatahub

test-curl-11184-f4a6d1

Scheduled

Successfully assigned opendatahub/test-curl-11184-f4a6d1 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt to ip-10-0-130-0.ec2.internal

models-as-a-service

payload-processing-external-model-5db9b8ddc4-mxg9x

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5db9b8ddc4-mxg9x to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g to ip-10-0-143-27.ec2.internal

models-as-a-service

payload-processing-external-model-5db9b8ddc4-psvgz

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5db9b8ddc4-psvgz to ip-10-0-143-27.ec2.internal

opendatahub

test-curl-11184-24dcbd

Scheduled

Successfully assigned opendatahub/test-curl-11184-24dcbd to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc to ip-10-0-143-27.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6 to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj to ip-10-0-142-110.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr to ip-10-0-143-27.ec2.internal

opendatahub

test-curl-11184-102e4f

Scheduled

Successfully assigned opendatahub/test-curl-11184-102e4f to ip-10-0-142-110.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4 to ip-10-0-143-27.ec2.internal

models-as-a-service

payload-processing-external-model-758758b45d-pnxwc

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-758758b45d-pnxwc to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww to ip-10-0-130-0.ec2.internal

openshift-ingress

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4 to ip-10-0-143-27.ec2.internal

openshift-ingress

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g to ip-10-0-143-27.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-75f7cfffd5 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-75f7cfffd5

SuccessfulCreate

Created pod: router-default-75f7cfffd5-4l7bn
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-75f7cfffd5-4l7bn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-75f7cfffd5-4l7bn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x2)

openshift-ingress

kubelet

router-default-75f7cfffd5-4l7bn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-75f7cfffd5-4l7bn

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-75f7cfffd5-4l7bn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-75f7cfffd5-4l7bn

Created

Container created

openshift-ingress

kubelet

router-default-75f7cfffd5-4l7bn

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-2gzsp

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-2gzsp

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2gzsp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2gzsp

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2gzsp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.675s (2.675s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2gzsp

Started

Container started
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2gzsp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-8pw9h

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75d7c785f from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2gzsp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-5cf4665f7f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-5cf4665f7f-8ml9q

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-5cf4665f7f from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cf4665f7f-8ml9q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-8pw9h

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-5cf4665f7f-8ml9q

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-8pw9h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-8pw9h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.869s (2.869s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cf4665f7f-8ml9q

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cf4665f7f-8ml9q

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cf4665f7f-8ml9q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.159s (8.159s including waiting). Image size: 183555333 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-66dfc65cbf

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-66dfc65cbf

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-66dfc65cbf-zns6d

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-66dfc65cbf

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-66dfc65cbf from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.727s (2.727s including waiting). Image size: 273709574 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.721s (2.721s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-6kg7d

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.98s (2.98s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 413ms (413ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-6kg7d

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-zns6d

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-6kg7d

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

opendatahub-operator-system

opendatahub-operator-controller-manager-66dfc65cbf-zns6d_1666cdd3-f444-4e32-a63e-b74ad99f91e6

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-66dfc65cbf-zns6d_1666cdd3-f444-4e32-a63e-b74ad99f91e6 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 313ms (313ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 319ms (319ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-d4r4z

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-6kg7d

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 1.893s (1.893s including waiting). Image size: 224874686 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-66dfc65cbf-dw6pk

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-6kg7d

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-6kg7d

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-6kg7d_b0129138-5b00-418d-8497-24262166ef64 became leader
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-7jgbv

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-57dvj

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-57dvj

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-57dvj

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-z4b6g

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-z4b6g

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-z4b6g

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-57dvj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 6.787s (6.787s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-z4b6g

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.499s (2.499s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-57dvj

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-57dvj

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-z4b6g

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-z4b6g

Created

Container created

kuadrant-system

dns-operator-controller-manager-8557cbdb84-z4b6g_f796c30a-b714-4e87-afe0-5349704b7dc1

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-z4b6g_f796c30a-b714-4e87-afe0-5349704b7dc1 became leader

kuadrant-system

limitador-operator-controller-manager-5778bb4449-57dvj_d95bf483-10f4-4875-afc3-b67303cd7761

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-57dvj_d95bf483-10f4-4875-afc3-b67303cd7761 became leader

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-8pws6

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-8pws6

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-8pws6

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-w5pkt

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-w5pkt

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-8pws6

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-8pws6

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-8pws6

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.727s (2.727s including waiting). Image size: 309650901 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-w5pkt

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-w5pkt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.284s (3.284s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-w5pkt

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-w5pkt

Created

Container created

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-w5pkt_72740bf2-1e13-42af-83d9-4d92e494a3b4

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-w5pkt_72740bf2-1e13-42af-83d9-4d92e494a3b4 became leader

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-f8g6j

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-f8g6j

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-f8g6j

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-7bd6fc9ff9

SuccessfulCreate

Created pod: kube-auth-proxy-7bd6fc9ff9-w5zwp

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-84d4d45d7c from 0 to 1

openshift-ingress

replicaset-controller

kube-auth-proxy-7bd6fc9ff9

SuccessfulCreate

Created pod: kube-auth-proxy-7bd6fc9ff9-m9zg8

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7bd6fc9ff9 from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

kuadrant-system

multus

authorino-operator-7b7bb4bc77-45k2d

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-45k2d

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing
(x2)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-45k2d

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-84d4d45d7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-84d4d45d7c5mcwv

openshift-ingress

kubelet

kube-auth-proxy-7bd6fc9ff9-w5zwp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-84d4d45d7c5mcwv

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7c5mcwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7c5mcwv

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7c5mcwv

Started

Container started

openshift-ingress

multus

kube-auth-proxy-7bd6fc9ff9-m9zg8

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7bd6fc9ff9-m9zg8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-7bd6fc9ff9-w5zwp

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-8fhqf

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing
(x2)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": tls: failed to verify certificate: x509: certificate signed by unknown authority

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8fhqf

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-45k2d

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-45k2d

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-45k2d

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.756s (1.756s including waiting). Image size: 167738465 bytes.

kuadrant-system

authorino-operator-7b7bb4bc77-45k2d_ea5179fc-3b9b-4c8f-bff6-7cfa3177f549

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-45k2d_ea5179fc-3b9b-4c8f-bff6-7cfa3177f549 became leader

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-f8g6j

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-f8g6j

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.706s (3.706s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-f8g6j

Started

Container started

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-8fhqf

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

kube-auth-proxy-7bd6fc9ff9-w5zwp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.296s (2.296s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7bd6fc9ff9-w5zwp

Started

Container started

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-b27jr

openshift-ingress

kubelet

kube-auth-proxy-7bd6fc9ff9-m9zg8

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7bd6fc9ff9-m9zg8

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7bd6fc9ff9-w5zwp

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7bd6fc9ff9-m9zg8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.667s (2.667s including waiting). Image size: 188904677 bytes.

cert-manager

multus

cert-manager-597b95cb84-b27jr

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-b27jr

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

kubelet

cert-manager-597b95cb84-b27jr

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.807s (2.807s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-b27jr

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-b27jr

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8fhqf

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8fhqf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.179s (6.179s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8fhqf

Started

Container started

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-zr7w4

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-zr7w4

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-zr7w4

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-zr7w4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.469s (1.469s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-zr7w4

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-zr7w4

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-lhjz4"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-vnkm8"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

opendatahub

kserve-module-controller-manager-7566cf5fc8-zr7w4_454f63b6-9375-46fb-a21f-790747cce4e1

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-zr7w4_454f63b6-9375-46fb-a21f-790747cce4e1 became leader

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-5c89ff7c87

SuccessfulCreate

Created pod: jobset-controller-manager-5c89ff7c87-fpdp6

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

multus

jobset-controller-manager-5c89ff7c87-fpdp6

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-5c89ff7c87-fpdp6

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-5c89ff7c87 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

jobset-controller-manager-5c89ff7c87-fpdp6_1c1f8759-3d82-499c-98fe-8218d83dd799

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-5c89ff7c87-fpdp6_1c1f8759-3d82-499c-98fe-8218d83dd799 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-5c89ff7c87-fpdp6

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.517s (2.517s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-5c89ff7c87-fpdp6

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-5c89ff7c87-fpdp6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5vjwt

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5vjwt

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5vjwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-5vjwt

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-5vjwt

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-w7p7b

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-25r9k

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5vjwt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

multus

model-serving-api-75bd89fdfc-9fjjh

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-w7p7b

opendatahub

kubelet

kserve-controller-manager-776cc66d47-25r9k

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-kpkmz

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w7p7b

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5vjwt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-9fjjh

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

multus

kserve-controller-manager-776cc66d47-25r9k

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2gzsp

Killing

Stopping container discovery

opendatahub

kubelet

model-serving-api-75bd89fdfc-9fjjh

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-2gzsp

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

odh-model-controller-769875db56-kpkmz

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-kpkmz

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-9fjjh

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w7p7b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.848s (2.848s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-25r9k

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.999s (3s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w7p7b

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w7p7b

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-25r9k

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-25r9k

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-9fjjh

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-9fjjh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.655s (2.656s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-kpkmz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.466s (3.466s including waiting). Image size: 236755567 bytes.

opendatahub

odh-model-controller-769875db56-kpkmz_b1ff0489-bc73-4157-bb94-82ab32b83540

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-kpkmz_b1ff0489-bc73-4157-bb94-82ab32b83540 became leader

opendatahub

kubelet

odh-model-controller-769875db56-kpkmz

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-kpkmz

Created

Container created

opendatahub

kserve-controller-manager-776cc66d47-25r9k_75eda621-a2f7-48fa-a407-1108fc8ef5ce

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-25r9k_75eda621-a2f7-48fa-a407-1108fc8ef5ce became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-w7p7b_839294ae-e80d-460e-945a-64418ed45024

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-w7p7b_839294ae-e80d-460e-945a-64418ed45024 became leader
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-rjj9l

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-w5pkt

Killing

Stopping container manager

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-rjj9l

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-rjj9l

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-rjj9l

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-rjj9l

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-rjj9l_dc0e60e3-9389-48ed-84e6-fa7403edfad8

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-rjj9l_dc0e60e3-9389-48ed-84e6-fa7403edfad8 became leader

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-vz5pc

kuadrant-system

multus

limitador-limitador-74dfcfb894-vz5pc

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-vz5pc

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-wtxbc

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-p2m8w

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-z7ctn

kuadrant-system

kubelet

authorino-56c6c9ddd5-z7ctn

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-z7ctn

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

multus

authorino-57f7f8659f-wtxbc

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-wtxbc

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

limitador-limitador-7c9b87d574-p2m8w

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-p2m8w

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-p2m8w

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 891ms (891ms including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-p2m8w

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-p2m8w

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-vz5pc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.158s (3.158s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-vz5pc

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-vz5pc

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-wtxbc

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-wtxbc

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-wtxbc

kuadrant-system

kubelet

authorino-56c6c9ddd5-z7ctn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.115s (2.115s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-z7ctn

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-z7ctn

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-wtxbc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.649s (2.649s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-wtxbc

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-vz5pc

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-vz5pc

Killing

Stopping container limitador

opendatahub

replicaset-controller

maas-controller-75b4575b56

SuccessfulCreate

Created pod: maas-controller-75b4575b56-7wgng

opendatahub

kubelet

maas-controller-6579864b68-5hcbw

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8d6921db01c0df05e20382b0469d2152d89933a9ec89b3b45026b72cdab0dbf2"

opendatahub

multus

maas-controller-6579864b68-5hcbw

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-6579864b68 from 0 to 1

opendatahub

replicaset-controller

maas-controller-6579864b68

SuccessfulCreate

Created pod: maas-controller-6579864b68-5hcbw

opendatahub

kubelet

maas-controller-75b4575b56-7wgng

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8d6921db01c0df05e20382b0469d2152d89933a9ec89b3b45026b72cdab0dbf2"

opendatahub

multus

maas-controller-75b4575b56-7wgng

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6579864b68-5hcbw

Created

Container created

opendatahub

kubelet

maas-controller-6579864b68-5hcbw

Started

Container started

opendatahub

kubelet

maas-controller-75b4575b56-7wgng

Created

Container created

opendatahub

kubelet

maas-controller-75b4575b56-7wgng

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8d6921db01c0df05e20382b0469d2152d89933a9ec89b3b45026b72cdab0dbf2" in 2.511s (2.511s including waiting). Image size: 200057367 bytes.

opendatahub

kubelet

maas-controller-75b4575b56-7wgng

Started

Container started

opendatahub

kubelet

maas-controller-6579864b68-5hcbw

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8d6921db01c0df05e20382b0469d2152d89933a9ec89b3b45026b72cdab0dbf2" in 2.697s (2.697s including waiting). Image size: 200057367 bytes.

opendatahub

maas-controller-6579864b68-5hcbw_0c6de1ba-5ddd-45f6-a755-147859261997

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6579864b68-5hcbw_0c6de1ba-5ddd-45f6-a755-147859261997 became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-6sv2d

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6sv2d

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-6sv2d

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6579864b68-5hcbw

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-6579864b68

SuccessfulDelete

Deleted pod: maas-controller-6579864b68-5hcbw

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-6579864b68 from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6sv2d

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.234s (10.234s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6sv2d

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6sv2d

Started

Container started

opendatahub

maas-controller-75b4575b56-7wgng_5762073e-0864-4583-a505-c480ffdc43d3

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-75b4575b56-7wgng_5762073e-0864-4583-a505-c480ffdc43d3 became leader

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-w8xm8

kuadrant-system

replicaset-controller

authorino-59cdc7947

SuccessfulCreate

Created pod: authorino-59cdc7947-244dk

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-w8xm8

kuadrant-system

multus

authorino-6f6944bcdd-bzgvb

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6f6944bcdd-bzgvb

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-59cdc7947 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-bzgvb

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-bzgvb

kuadrant-system

kubelet

authorino-59cdc7947-244dk

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-bzgvb

Started

Container started

kuadrant-system

kubelet

authorino-59cdc7947-244dk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 509ms (509ms including waiting). Image size: 204096810 bytes.

kuadrant-system

multus

authorino-59cdc7947-244dk

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-59cdc7947-244dk

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-59cdc7947-244dk

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-bzgvb

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-8pw9h

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-8pw9h

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-8pw9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-6f6944bcdd-bzgvb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 866ms (866ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-bzgvb

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-z7ctn

kuadrant-system

kubelet

authorino-56c6c9ddd5-z7ctn

Killing

Stopping container authorino

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-wptrw

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-6466c554d8-wptrw

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-wptrw

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-wptrw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 687ms (687ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-wptrw

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-wptrw

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-8pw9h

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-8pw9h

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w7p7b

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-w7p7b

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-pd2tp

opendatahub

kubelet

ai-gateway-controller-7d85675f98-pd2tp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-pd2tp

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

ai-gateway-controller-7d85675f98-pd2tp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.533s (1.533s including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-pd2tp

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-pd2tp

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-pd2tp_5212c25e-a96d-4f90-b013-6ffbd1c063bd

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-pd2tp_5212c25e-a96d-4f90-b013-6ffbd1c063bd became leader
(x5)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-7b98bb678c-xsvkx

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-xsvkx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-processing-5f78687d5b-qfc9q

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-qfc9q

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xsvkx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-qfc9q

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xsvkx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.262s (2.262s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xsvkx

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-qfc9q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.361s (2.361s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-qfc9q

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-qfc9q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xsvkx

Created

Container created

opendatahub

replicaset-controller

ai-gateway-controller-67f4f4fc68

SuccessfulCreate

Created pod: ai-gateway-controller-67f4f4fc68-mtts8

opendatahub

llmisvc-controller-manager-6466c554d8-wptrw_dfe92b1b-a706-4f06-9dae-edffd62b4c97

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-wptrw_dfe92b1b-a706-4f06-9dae-edffd62b4c97 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-67f4f4fc68 from 0 to 1

opendatahub

multus

ai-gateway-controller-67f4f4fc68-mtts8

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-67f4f4fc68-mtts8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-67f4f4fc68-mtts8

Created

Container created

opendatahub

kubelet

ai-gateway-controller-67f4f4fc68-mtts8

Started

Container started

opendatahub

kubelet

ai-gateway-controller-67f4f4fc68-mtts8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 325ms (325ms including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-pd2tp

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-pd2tp

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-srspl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-srspl

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-srspl

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-srspl

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-srspl

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-srspl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.258s (1.258s including waiting). Image size: 98346788 bytes.

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-8mxxx

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-8mxxx

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-8mxxx

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 199ms (199ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-8mxxx

Created

Container created

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-8mxxx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-8mxxx

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-4dsxw

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-4dsxw

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4dsxw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-v5zns

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4dsxw

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4dsxw

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-4dsxw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.096s (1.096s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-v5zns

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-v5zns

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-v5zns

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-v5zns

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 179ms (179ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-v5zns

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82qnb6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82qnb6

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82qnb6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 190ms (190ms including waiting). Image size: 98346788 bytes.

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82qnb6

Created

Container created

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82qnb6

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82qnb6

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-dw8g7

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-cpmfd

opendatahub

ai-gateway-controller-67f4f4fc68-mtts8_87a69e33-06f4-4d47-90b6-59c43d0d1c1d

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-67f4f4fc68-mtts8_87a69e33-06f4-4d47-90b6-59c43d0d1c1d became leader

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

multus

echo-simulator-kserve-64b6f8f96c-dw8g7

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cpmfd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 185ms (185ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cpmfd

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

kubelet

echo-simulator-kserve-64b6f8f96c-dw8g7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.662s (1.662s including waiting). Image size: 78208878 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cpmfd

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-cpmfd

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cpmfd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default
(x2)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-dw8g7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-dw8g7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 185ms (185ms including waiting). Image size: 78208878 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-dw8g7

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 184ms (184ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Started

Container started
(x2)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-dw8g7

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75d7c785f from 1 to 3

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-fl6gr

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-fl6gr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-57s4v

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-57s4v

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

kuadrant-system

kubelet

authorino-7795bf7868-gmhpg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-7795bf7868-gmhpg

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-7795bf7868

SuccessfulCreate

Created pod: authorino-7795bf7868-gmhpg

kuadrant-system

kubelet

authorino-7795bf7868-gmhpg

Started

Container started

kuadrant-system

kubelet

authorino-7795bf7868-gmhpg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.957s (2.957s including waiting). Image size: 183555333 bytes.

kuadrant-system

kubelet

authorino-7795bf7868-gmhpg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 588ms (588ms including waiting). Image size: 204096810 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

Started

Container started

kuadrant-system

kubelet

authorino-59cdc7947-244dk

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-59cdc7947

SuccessfulDelete

Deleted pod: authorino-59cdc7947-244dk
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-59cdc7947 from 1 to 0
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75d7c785f from 3 to 6

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-nzg5g

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-gjlm2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nzg5g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-gjlm2

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-zghmk

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zghmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zghmk

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-gjlm2

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-gjlm2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nzg5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zghmk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nzg5g

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-nzg5g

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-gjlm2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-zghmk
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zghmk

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zghmk

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-gjlm2

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-gjlm2

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nzg5g

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nzg5g

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-46t2r

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75d7c785f from 6 to 7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-46t2r

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-46t2r

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-46t2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-46t2r

Created

Container created

openshift-ingress

multus

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c

SuccessfulCreate

Created pod: e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

openshift-ingress

gateway_labeler_controller

e2e-ait-bc6b04f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-bc6b04f0

openshift-ingress

deployment-controller

e2e-ait-bc6b04f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-bc6b04f0-openshift-default-7c87448c5f from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-61b6469a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-61b6469a-openshift-default-7879947fc5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-7664a237-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7664a237-gw

openshift-ingress

deployment-controller

e2e-migrate-7664a237-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-bc6b04f0-openshift-default-7c87448c5f

SuccessfulCreate

Created pod: e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

openshift-ingress

replicaset-controller

e2e-ait-61b6469a-openshift-default-7879947fc5

SuccessfulCreate

Created pod: e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

openshift-ingress

gateway_labeler_controller

e2e-ait-61b6469a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-61b6469a

openshift-ingress

deployment-controller

e2e-ait-14b53b75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-14b53b75-openshift-default-66869b97f5 from 0 to 1

openshift-ingress

multus

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-14b53b75-openshift-default-66869b97f5

SuccessfulCreate

Created pod: e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

openshift-ingress

gateway_labeler_controller

e2e-ait-14b53b75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-14b53b75

openshift-ingress

multus

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-46t2r

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-46t2r

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-bc6b04f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-bc6b04f0-7944b685f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-bc6b04f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-bc6b04f0-857d8b75bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bc6b04f0-857d8b75bd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-bc6b04f0-857d8b75bd-bcvpw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bc6b04f0-857d8b75bd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-bc6b04f0-857d8b75bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bc6b04f0: serviceaccount "payload-processing-e2e-ait-bc6b04f0" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bc6b04f0-7944b685f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bc6b04f0: serviceaccount "payload-processing-e2e-ait-bc6b04f0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bc6b04f0-7944b685f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-45f4s

openshift-ingress

kubelet

payload-processing-e2e-ait-bc6b04f0-857d8b75bd-bcvpw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-45f4s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-bc6b04f0-857d8b75bd-bcvpw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-bc6b04f0-857d8b75bd-bcvpw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-45f4s

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-45f4s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-45f4s

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-bc6b04f0-857d8b75bd-bcvpw

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-61b6469a-d856545d4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-61b6469a-d856545d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-61b6469a: serviceaccount "payload-processing-e2e-ait-61b6469a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-61b6469a-d856545d4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-61b6469a-d856545d4-2z75s

openshift-ingress

deployment-controller

payload-processing-e2e-ait-61b6469a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-61b6469a-d856545d4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-61b6469a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-61b6469a: serviceaccount "payload-processing-e2e-ait-61b6469a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-61b6469a-d856545d4-2z75s

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7664a237-577f9d5b4

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7664a237-577f9d5b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7664a237: serviceaccount "payload-processing-e2e-migrate-7664a237" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7664a237

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7

openshift-ingress

multus

payload-processing-e2e-ait-61b6469a-d856545d4-2z75s

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7664a237: serviceaccount "payload-processing-e2e-migrate-7664a237" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7664a237

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7664a237-577f9d5b4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7664a237-577f9d5b4

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7664a237-577f9d5b4-kzhqr

openshift-ingress

kubelet

payload-processing-e2e-migrate-7664a237-577f9d5b4-kzhqr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-migrate-7664a237-577f9d5b4-kzhqr

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-7664a237-577f9d5b4-kzhqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-7664a237-577f9d5b4-kzhqr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-61b6469a-d856545d4-2z75s

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-14b53b75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-14b53b75-546f8c66ff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-14b53b75-66cd655bd8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-14b53b75-66cd655bd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-14b53b75: serviceaccount "payload-processing-e2e-ait-14b53b75" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-61b6469a-d856545d4-2z75s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.742s (2.742s including waiting). Image size: 125317101 bytes.

openshift-ingress

gateway_labeler_controller

e2e-derive-6c3505dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6c3505dc

openshift-ingress

deployment-controller

payload-processing-e2e-ait-14b53b75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-14b53b75-66cd655bd8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-61b6469a-d856545d4-2z75s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.721s (2.721s including waiting). Image size: 125317101 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-14b53b75-546f8c66ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-14b53b75: serviceaccount "payload-processing-e2e-ait-14b53b75" not found

openshift-ingress

deployment-controller

e2e-derive-6c3505dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6c3505dc-openshift-default-66b5c6c749 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-6c3505dc-openshift-default-66b5c6c749

SuccessfulCreate

Created pod: e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-14b53b75-546f8c66ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-zb98v

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.448s (2.448s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-14b53b75-66cd655bd8-rqk8z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-14b53b75-66cd655bd8-rqk8z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-zb98v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-zb98v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-14b53b75-66cd655bd8-rqk8z

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-zb98v

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-zb98v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-14b53b75-66cd655bd8-rqk8z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-14b53b75-66cd655bd8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-14b53b75-66cd655bd8-rqk8z

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-7664a237-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6c3505dc: serviceaccount "payload-processing-e2e-derive-6c3505dc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6c3505dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-d99vq

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-7664a237-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6c3505dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6c3505dc-68c5ff6c98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6c3505dc-68c5ff6c98

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6c3505dc-68c5ff6c98-qgtfj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6c3505dc-68c5ff6c98

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6c3505dc-68c5ff6c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6c3505dc: serviceaccount "payload-processing-e2e-derive-6c3505dc" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-d99vq

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6c3505dc-68c5ff6c98-qgtfj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-d99vq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-d99vq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-d99vq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-6c3505dc-68c5ff6c98-qgtfj

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6c3505dc-68c5ff6c98-qgtfj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-6c3505dc-68c5ff6c98-qgtfj

Started

Container started

openshift-ingress

kubelet

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bc6b04f0-7944b685f-45f4s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bc6b04f0-857d8b75bd-bcvpw

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-7664a237-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-bc6b04f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-bc6b04f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-61b6469a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-61b6469a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-7664a237-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-14b53b75-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-14b53b75-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-7664a237-577f9d5b4-kzhqr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7664a237-6fdb9ccb8c-5g9q7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

Created

Container created

openshift-ingress

kubelet

e2e-ait-bc6b04f0-openshift-default-7c87448c5f-mtcbd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-migrate-7664a237-gw-openshift-default-6c4697dd5c-bw4tg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6c3505dc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-719029

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-719029

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-78d5ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-78d5ff

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-61b6469a-d856545d4-2z75s

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6c3505dc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 0 to 1

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-61b6469a-6fc6d565dc-p6v74

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-14b53b75-66cd655bd8-rqk8z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-14b53b75-546f8c66ff-zb98v

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-b93d51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-b93d51

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 0 to 1

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-78d5ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-78d5ff-7c6d864484 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-78d5ff-7c6d864484

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-78d5ff-7c6d864484-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-78d5ff: serviceaccount "payload-processing-e2e-worker-w3-78d5ff" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-78d5ff: serviceaccount "payload-processing-e2e-worker-w3-78d5ff" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6

openshift-ingress

kubelet

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-78d5ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-78d5ff-7c6d864484

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-c40a89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-c40a89

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-719029-66c86885dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-719029-66c86885dc-klbw6

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-719029-66c86885dc-klbw6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-719029-68f6795878

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-719029-68f6795878-p8vdz

openshift-ingress

kubelet

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-719029-68f6795878

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-719029-68f6795878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-719029: serviceaccount "payload-processing-e2e-worker-w2-719029" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-719029-66c86885dc-klbw6

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-719029

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-719029-68f6795878 from 0 to 1

openshift-ingress

kubelet

e2e-ait-61b6469a-openshift-default-7879947fc5-rqm7r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-719029

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-719029-66c86885dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-719029-66c86885dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-719029-66c86885dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-719029: serviceaccount "payload-processing-e2e-worker-w2-719029" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-719029-66c86885dc-klbw6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-719029-66c86885dc-klbw6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w2-719029-68f6795878-p8vdz

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-719029-68f6795878-p8vdz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-719029-68f6795878-p8vdz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-719029-68f6795878-p8vdz

Created

Container created

openshift-ingress

kubelet

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-14b53b75-openshift-default-66869b97f5-djcbh

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-b93d51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-b93d51-66c97d5bb6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b93d51: serviceaccount "payload-processing-e2e-worker-w4-b93d51" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b93d51: serviceaccount "payload-processing-e2e-worker-w4-b93d51" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-b93d51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-c40a89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-c40a89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-c40a89-6759b44d8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c40a89-6759b44d8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-c40a89-6759b44d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c40a89: serviceaccount "payload-processing-e2e-worker-w0-c40a89" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c40a89: serviceaccount "payload-processing-e2e-worker-w0-c40a89" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c40a89-6759b44d8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-6c3505dc-68c5ff6c98-qgtfj

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6c3505dc-79bf4bd659-d99vq

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6c3505dc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6c3505dc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

Created

Container created

openshift-ingress

kubelet

e2e-derive-6c3505dc-openshift-default-66b5c6c749-bm4hd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-f6f4f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-f6f4f0

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-f6f4f0-7447ff75b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-f6f4f0: serviceaccount "payload-processing-e2e-worker-w1-f6f4f0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-f6f4f0-7447ff75b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-wxn5z

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-f6f4f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-f6f4f0-7447ff75b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-f6f4f0: serviceaccount "payload-processing-e2e-worker-w1-f6f4f0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-f6f4f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-wxn5z

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-wxn5z

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-wxn5z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-wxn5z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 1 to 2

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

Started

Container started

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 2 to 4
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

Started

Container started

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

Created

Container created

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

Created

Container created

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 4 to 5

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

Started

Container started

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

Started

Container started

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 5 to 7

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-5p677
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

Started

Container started

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 7 to 9

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

Started

Container started

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 8 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 9; reason:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 7 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

Started

Container started
(x10)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

Created

Container created

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Unhealthy

Readiness probe failed: Get "https://10.132.0.46:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 9 to 10

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 4 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 8 to 10

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

Started

Container started

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Unhealthy

Liveness probe failed: Get "https://10.132.0.46:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-mt-2933ff00-openshift-default-5544ff85d5

SuccessfulCreate

Created pod: e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

openshift-ingress

gateway_labeler_controller

e2e-mt-2933ff00

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2933ff00

openshift-ingress

deployment-controller

e2e-mt-2933ff00-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2933ff00-openshift-default-5544ff85d5 from 0 to 1

openshift-ingress

multus

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-2198e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2198e4

openshift-ingress

deployment-controller

e2e-api-a-2198e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2198e4-openshift-default-5fdf99b4c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-2198e4-openshift-default-5fdf99b4c

SuccessfulCreate

Created pod: e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

openshift-ingress

multus

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

ProbeError

Readiness probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

Unhealthy

Readiness probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Unhealthy

Liveness probe failed: Get "https://10.132.0.46:8000/health": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

ProbeError

Readiness probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2933ff00: serviceaccount "payload-processing-e2e-mt-2933ff00" not found

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

Unhealthy

Readiness probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2933ff00

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2933ff00-7574c49c54

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2933ff00-7574c49c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2933ff00: serviceaccount "payload-processing-e2e-mt-2933ff00" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2933ff00-7574c49c54

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2933ff00

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2933ff00-7574c49c54 from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

multus

payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2198e4-585bd74748

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2198e4-585bd74748-5sfg7

openshift-ingress

multus

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-qrbgc

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2198e4: serviceaccount "payload-processing-e2e-api-a-2198e4" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2198e4-585bd74748

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2198e4-585bd74748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2198e4: serviceaccount "payload-processing-e2e-api-a-2198e4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2198e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2198e4-585bd74748 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2198e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-qrbgc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-qrbgc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-qrbgc

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2198e4-585bd74748-5sfg7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-qrbgc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-2198e4-585bd74748-5sfg7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-2198e4-585bd74748-5sfg7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-2198e4-585bd74748-5sfg7

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Unhealthy

Readiness probe failed: Get "https://10.132.0.46:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75d7c785f from 7 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-kf6tq

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-nw522

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-sdrx5

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-sdrx5

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-nw522

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-kf6tq

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nw522

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nw522

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nw522

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

Created

Container created

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nw522

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nw522

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-xr74l

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-xr74l

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr74l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr74l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.454s (3.454s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr74l

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr74l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

Created

Container created

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

Created

Container created

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

Started

Container started

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 7 to 10

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

gateway_labeler_controller

e2e-api-b-c2993e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-c2993e

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 3 to 5

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

Created

Container created

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-c2993e-openshift-default-7cb8894cb9

SuccessfulCreate

Created pod: e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-c2993e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-c2993e-openshift-default-7cb8894cb9 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-c2993e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-c2993e-7879c4999f from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-c2993e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-c2993e-6965595d66 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c2993e-6965595d66

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-c2993e-6965595d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c2993e: serviceaccount "payload-processing-e2e-api-b-c2993e" not found
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c2993e-6965595d66

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c2993e-7879c4999f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c2993e-7879c4999f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-c2993e-7879c4999f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c2993e: serviceaccount "payload-processing-e2e-api-b-c2993e" not found
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2198e4-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-2198e4-openshift-default-5fdf99b4c

SuccessfulCreate

Created pod: e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

openshift-ingress

replicaset-controller

e2e-api-a-2198e4-openshift-default-5fdf99b4c

SuccessfulCreate

Created pod: e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

openshift-ingress

replicaset-controller

e2e-api-a-2198e4-openshift-default-5fdf99b4c

SuccessfulCreate

Created pod: e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

openshift-ingress

deployment-controller

e2e-api-a-2198e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2198e4-openshift-default-5fdf99b4c from 1 to 4

openshift-ingress

multus

e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

Started

Container started

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

Started

Container started

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

Created

Container created

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

Started

Container started

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

Created

Container created

openshift-ingress

multus

e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2933ff00-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2933ff00-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2198e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2198e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-api-a-922b2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-922b2c-openshift-default-64b4cfc669 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-922b2c-openshift-default-64b4cfc669

SuccessfulCreate

Created pod: e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

openshift-ingress

gateway_labeler_controller

e2e-api-a-922b2c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-922b2c

openshift-ingress

kubelet

payload-processing-e2e-api-a-2198e4-585bd74748-5sfg7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2198e4-7ffb8866c9-qrbgc

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-922b2c-66bf787d66

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-922b2c-66bf787d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-922b2c: serviceaccount "payload-processing-e2e-api-a-922b2c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-922b2c: serviceaccount "payload-processing-e2e-api-a-922b2c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-922b2c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-922b2c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-922b2c-66bf787d66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-922b2c-66bf787d66

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-922b2c-66bf787d66-msht8

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld
(x2)

openshift-ingress

kubelet

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-922b2c-66bf787d66-msht8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-922b2c-66bf787d66-msht8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-922b2c-66bf787d66-msht8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-922b2c-66bf787d66-msht8

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2933ff00-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2933ff00-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

Started

Container started

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

Created

Container created

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

Started

Container started

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c2993e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c2993e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-btkz8

Killing

Stopping container istio-proxy
(x11)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Unhealthy

Readiness probe failed: Get "https://10.132.0.46:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-5k2f7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-rgnzl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

ProbeError

Readiness probe error: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

Unhealthy

Readiness probe failed: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-2198e4-openshift-default-5fdf99b4c-59nns

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

Unhealthy

Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

ProbeError

Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mk4gj

Unhealthy

Readiness probe failed: Get "https://10.132.0.46:8000/ready": context deadline exceeded
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x3)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-8pws6

Unhealthy

Liveness probe failed: Get "http://10.133.0.27:6080/livez": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-dw8g7

Unhealthy

Readiness probe failed: Get "https://10.132.0.45:8000/ready": context deadline exceeded
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x3)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-8pws6

Unhealthy

Readiness probe failed: Get "http://10.133.0.27:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x11)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-mt-2933ff00-openshift-default-5544ff85d5

SuccessfulCreate

Created pod: e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2933ff00-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-2933ff00-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2933ff00-openshift-default-5544ff85d5 from 1 to 2

openshift-ingress

multus

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

Created

Container created

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c2993e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c2993e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-c2993e-6965595d66-mwsdl

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.90:50052" within 1s: context deadline exceeded

opendatahub

multus

test-curl-11184-f4a6d1

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11184-f4a6d1

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c2993e-7879c4999f-tsbxd

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.91:50052" within 1s: context deadline exceeded

openshift-ingress

replicaset-controller

e2e-api-a-c93367-openshift-default-7db9fc476c

SuccessfulCreate

Created pod: e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

openshift-ingress

deployment-controller

e2e-api-a-c93367-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c93367-openshift-default-7db9fc476c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-c93367

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c93367

openshift-ingress

multus

e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11184-f4a6d1

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 8.037s (8.037s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11184-f4a6d1

Started

Container started

opendatahub

kubelet

test-curl-11184-f4a6d1

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922b2c-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-922b2c-openshift-default-64b4cfc669

SuccessfulCreate

Created pod: e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

openshift-ingress

replicaset-controller

e2e-api-a-922b2c-openshift-default-64b4cfc669

SuccessfulCreate

Created pod: e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

openshift-ingress

deployment-controller

e2e-api-a-922b2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-922b2c-openshift-default-64b4cfc669 from 1 to 4

openshift-ingress

replicaset-controller

e2e-api-a-922b2c-openshift-default-64b4cfc669

SuccessfulCreate

Created pod: e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

opendatahub

kubelet

test-curl-11184-f4a6d1

Killing

Stopping container test-curl-11184-f4a6d1

openshift-ingress

replicaset-controller

e2e-api-b-b2c11f-openshift-default-7c88c4b97c

SuccessfulCreate

Created pod: e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c93367

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c93367-967fd786c from 0 to 1

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c93367-6666bff5bd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c93367-6666bff5bd-8pcq4

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c93367

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c93367-6666bff5bd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c93367-6666bff5bd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c93367-6666bff5bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c93367: serviceaccount "payload-processing-e2e-api-a-c93367" not found

openshift-ingress

multus

e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-b2c11f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b2c11f-openshift-default-7c88c4b97c from 0 to 1

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-b-b2c11f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b2c11f

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

Created

Container created

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c93367-967fd786c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c93367-967fd786c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c93367: serviceaccount "payload-processing-e2e-api-a-c93367" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c93367-967fd786c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c93367-967fd786c-r7vg5

openshift-ingress

multus

payload-processing-e2e-api-a-c93367-6666bff5bd-8pcq4

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c93367-6666bff5bd-8pcq4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

Created

Container created

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c93367-967fd786c-r7vg5

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c93367-967fd786c-r7vg5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c93367-6666bff5bd-8pcq4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c93367-6666bff5bd-8pcq4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c93367-967fd786c-r7vg5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c93367-967fd786c-r7vg5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b2c11f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b2c11f: serviceaccount "payload-processing-e2e-api-b-b2c11f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-j4vvf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b2c11f-777dbfbc54

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b2c11f-777dbfbc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b2c11f: serviceaccount "payload-processing-e2e-api-b-b2c11f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b2c11f-777dbfbc54

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b2c11f-777dbfbc54-n2jtr

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b2c11f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b2c11f-777dbfbc54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-b2c11f-777dbfbc54-n2jtr

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-b2c11f-777dbfbc54-n2jtr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-b2c11f-777dbfbc54-n2jtr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-j4vvf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-j4vvf

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-b2c11f-777dbfbc54-n2jtr

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-j4vvf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-j4vvf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-c2993e-openshift-default-7cb8894cb9-2lvk6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922b2c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922b2c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zghmk

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zghmk

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c93367-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c93367-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922b2c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922b2c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b2c11f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b2c11f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-6h77v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-r9hg4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-api-b-2818a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2818a6
(x2)

openshift-ingress

kubelet

e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-2818a6-openshift-default-bf45b947f

SuccessfulCreate

Created pod: e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

openshift-ingress

deployment-controller

e2e-api-b-2818a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2818a6-openshift-default-bf45b947f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922b2c-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

multus

e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-922b2c-openshift-default-64b4cfc669

SuccessfulCreate

Created pod: e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

openshift-ingress

replicaset-controller

e2e-api-a-922b2c-openshift-default-64b4cfc669

SuccessfulCreate

Created pod: e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

openshift-ingress

multus

e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

Created

Container created

openshift-ingress

deployment-controller

e2e-api-a-922b2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-922b2c-openshift-default-64b4cfc669 from 4 to 6

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

Created

Container created

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

Started

Container started

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2818a6-6fc6bff7c6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2818a6-6fc6bff7c6-vx86g
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2818a6-6fc6bff7c6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2818a6-6fc6bff7c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2818a6: serviceaccount "payload-processing-e2e-api-b-2818a6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2818a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2818a6-6fc6bff7c6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2818a6-586fb4d987

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2818a6-586fb4d987-bvv67
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2818a6-586fb4d987

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2818a6-586fb4d987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2818a6: serviceaccount "payload-processing-e2e-api-b-2818a6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2818a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2818a6-586fb4d987 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2818a6-586fb4d987-bvv67

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2818a6-586fb4d987-bvv67

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2818a6-586fb4d987-bvv67

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-api-b-2818a6-6fc6bff7c6-vx86g

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2818a6-586fb4d987-bvv67

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-2818a6-6fc6bff7c6-vx86g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2818a6-6fc6bff7c6-vx86g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-2818a6-6fc6bff7c6-vx86g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-922b2c-66bf787d66-msht8

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bd098e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bd098e
(x5)

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-bd098e-openshift-default-8b546f85f

SuccessfulCreate

Created pod: e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

openshift-ingress

multus

e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-bd098e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bd098e-openshift-default-8b546f85f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2933ff00

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2933ff00-7574c49c54 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2933ff00-7574c49c54

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2933ff00-7574c49c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2933ff00: serviceaccount "payload-processing-e2e-mt-2933ff00" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2933ff00-7574c49c54

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2933ff00-7574c49c54-nnhq8
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2933ff00: serviceaccount "payload-processing-e2e-mt-2933ff00" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2933ff00

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922b2c-5f6bb77b59-mssld

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.94:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-api-a-922b2c-66bf787d66-msht8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.95:50052" within 1s: context deadline exceeded

openshift-ingress

multus

payload-processing-e2e-mt-2933ff00-7574c49c54-nnhq8

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-v52zs

openshift-ingress

multus

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-v52zs

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-nnhq8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-v52zs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-nnhq8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-nnhq8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-v52zs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-v52zs

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bd098e: serviceaccount "payload-processing-e2e-ipp-a-bd098e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bd098e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bd098e-676766d5fb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bd098e-676766d5fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bd098e-676766d5fb-lfkpd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bd098e-676766d5fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bd098e-676766d5fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bd098e: serviceaccount "payload-processing-e2e-ipp-a-bd098e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bd098e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-2drtb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-2drtb

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-2drtb

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-bd098e-676766d5fb-lfkpd

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-2drtb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-676766d5fb-lfkpd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-2drtb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-676766d5fb-lfkpd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-676766d5fb-lfkpd

Started

Container started

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

ProbeError

Readiness probe error: Get "http://10.134.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

Unhealthy

Readiness probe failed: Get "http://10.134.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-tqrlv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-5brlf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-qftpn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-zd5wl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-bhc9k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-922b2c-openshift-default-64b4cfc669-jftcr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b2c11f-6fc664b8c-j4vvf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b2c11f-777dbfbc54-n2jtr

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c93367-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c93367-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b2c11f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b2c11f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

test-curl-11184-24dcbd

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11184-24dcbd

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-11184-24dcbd

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 643ms (643ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11184-24dcbd

Created

Container created

opendatahub

kubelet

test-curl-11184-24dcbd

Started

Container started

opendatahub

kubelet

test-curl-11184-24dcbd

Killing

Stopping container test-curl-11184-24dcbd

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c93367-967fd786c-r7vg5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-c93367-6666bff5bd-8pcq4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

Started

Container started

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-676766d5fb-lfkpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-5dc78f5475-2drtb

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-a-7542fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7542fa-openshift-default-65c497d8b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7542fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7542fa

openshift-ingress

replicaset-controller

e2e-ipp-a-7542fa-openshift-default-65c497d8b9

SuccessfulCreate

Created pod: e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

openshift-ingress

multus

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-b2c11f-openshift-default-7c88c4b97c-jnwcv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7542fa-56c9884798

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7542fa-56c9884798-4vnfc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7542fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7542fa-56c9884798 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7542fa-56c9884798

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7542fa-56c9884798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7542fa: serviceaccount "payload-processing-e2e-ipp-a-7542fa" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7542fa: serviceaccount "payload-processing-e2e-ipp-a-7542fa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7542fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7542fa-556c95c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7542fa-56c9884798-4vnfc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7542fa-56c9884798-4vnfc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7542fa-56c9884798-4vnfc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-7542fa-56c9884798-4vnfc

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n

Created

Container created

openshift-ingress

kubelet

e2e-api-a-c93367-openshift-default-7db9fc476c-khlq4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2818a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bd098e: serviceaccount "payload-processing-e2e-ipp-a-bd098e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bd098e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bd098e-5d46cf4f46 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2818a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bd098e: serviceaccount "payload-processing-e2e-ipp-a-bd098e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bd098e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bd098e-69b494c675 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp

openshift-ingress

multus

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.542s (1.542s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.486s (1.486s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-2818a6-6fc6bff7c6-vx86g

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2818a6-586fb4d987-bvv67

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bd098e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bd098e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2818a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2818a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-ipp-b-86dd79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-86dd79-openshift-default-b5cd9fb85 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-86dd79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-86dd79

openshift-ingress

replicaset-controller

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85

SuccessfulCreate

Created pod: e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

openshift-ingress

multus

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-86dd79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-86dd79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-86dd79: serviceaccount "payload-processing-e2e-ipp-b-86dd79" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-86dd79: serviceaccount "payload-processing-e2e-ipp-b-86dd79" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-jl8hl

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2933ff00-7574c49c54-nnhq8

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-rgsbw

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-jl8hl

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-rgsbw

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-rgsbw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2933ff00-66f5ddbb99-v52zs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-jl8hl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-rgsbw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-rgsbw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-jl8hl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-jl8hl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7542fa-56c9884798-4vnfc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7542fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7542fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

Started

Container started

openshift-ingress

kubelet

e2e-api-b-2818a6-openshift-default-bf45b947f-kbtxx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-556c95c5-dls8n

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.114:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

e2e-ipp-a-954773-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-954773-openshift-default-f9885dc7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-954773

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-954773

openshift-ingress

replicaset-controller

e2e-ipp-a-954773-openshift-default-f9885dc7

SuccessfulCreate

Created pod: e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

openshift-ingress

multus

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bd098e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bd098e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-954773

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-954773-5974987546 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-954773-5974987546

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-954773-5974987546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-954773: serviceaccount "payload-processing-e2e-ipp-a-954773" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-954773-6b46c87747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-954773-6b46c87747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-954773: serviceaccount "payload-processing-e2e-ipp-a-954773" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-954773

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-954773-6b46c87747 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-954773-5974987546-jmjmm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-954773-6b46c87747-zb7xx

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-954773-5974987546-jmjmm

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-954773-5974987546

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-954773-5974987546-jmjmm

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-954773-5974987546-jmjmm

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-954773-6b46c87747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-954773-6b46c87747-zb7xx

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-954773-5974987546-jmjmm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-954773-6b46c87747-zb7xx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-954773-6b46c87747-zb7xx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-954773-6b46c87747-zb7xx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7542fa: serviceaccount "payload-processing-e2e-ipp-a-7542fa" not found
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7542fa-5fff779d4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7542fa-5fff779d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7542fa: serviceaccount "payload-processing-e2e-ipp-a-7542fa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7542fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7542fa-5fff779d4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7542fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-7542fa-5fff779d4-p5p5g

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-86dd79-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7542fa-5fff779d4-p5p5g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7542fa-5fff779d4-p5p5g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7542fa-5fff779d4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7542fa-5fff779d4-p5p5g

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7542fa-5fff779d4-p5p5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-86dd79-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-b273b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b273b6

openshift-ingress

deployment-controller

e2e-api-a-b273b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b273b6-openshift-default-55d489cc49 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-b273b6-openshift-default-55d489cc49

SuccessfulCreate

Created pod: e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

openshift-ingress

multus

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-hxtd5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-2933ff00-openshift-default-5544ff85d5-55ck2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b273b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-vp85w
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b273b6-6bcd8bb886

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b273b6-6bcd8bb886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b273b6: serviceaccount "payload-processing-e2e-api-a-b273b6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b273b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b273b6-6bcd8bb886 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b273b6: serviceaccount "payload-processing-e2e-api-a-b273b6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b273b6-6bcd8bb886

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b273b6-6bcd8bb886-4mhbb

openshift-ingress

multus

payload-processing-e2e-api-a-b273b6-6bcd8bb886-4mhbb

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-b273b6-6bcd8bb886-4mhbb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-vp85w

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-vp85w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-vp85w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-vp85w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-b273b6-6bcd8bb886-4mhbb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-b273b6-6bcd8bb886-4mhbb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7542fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7542fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85

SuccessfulCreate

Created pod: e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

openshift-ingress

deployment-controller

e2e-ipp-b-86dd79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-86dd79-openshift-default-b5cd9fb85 from 1 to 4

openshift-ingress

replicaset-controller

e2e-ipp-b-6ba1d9-openshift-default-587457755f

SuccessfulCreate

Created pod: e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

openshift-ingress

replicaset-controller

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85

SuccessfulCreate

Created pod: e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-86dd79-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-b-6ba1d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6ba1d9-openshift-default-587457755f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-5c90f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-5c90f5

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6ba1d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6ba1d9

openshift-ingress

replicaset-controller

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85

SuccessfulCreate

Created pod: e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-5c90f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-5c90f5-openshift-default-6876c6b675 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

Started

Container started

openshift-ingress

multus

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

Created

Container created

openshift-ingress

multus

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-5c90f5-openshift-default-6876c6b675

SuccessfulCreate

Created pod: e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

Created

Container created

openshift-ingress

multus

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

Unhealthy

Readiness probe failed: Get "http://10.134.0.118:15021/healthz/ready": read tcp 10.134.0.2:44994->10.134.0.118:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

ProbeError

Readiness probe error: Get "http://10.134.0.118:15021/healthz/ready": read tcp 10.134.0.2:44994->10.134.0.118:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dd79-57bdfbd4c4-rgsbw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dd79-57c99bdc9f-jl8hl

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-bt6gz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6ba1d9: serviceaccount "payload-processing-e2e-ipp-b-6ba1d9" not found
(x6)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

ProbeError

Startup probe error: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6ba1d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

Unhealthy

Startup probe failed: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6ba1d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6ba1d9: serviceaccount "payload-processing-e2e-ipp-b-6ba1d9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-4874l

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-4djss

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-4djss

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-4874l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-4djss

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-4djss
(x6)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-4874l

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-4djss

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-4874l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-4874l

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5c90f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5c90f5: serviceaccount "payload-processing-e2e-ipp-a-5c90f5" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5c90f5: serviceaccount "payload-processing-e2e-ipp-a-5c90f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-zft8k

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-mvdkm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5c90f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-mvdkm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-zft8k

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-mvdkm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-mvdkm

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-mvdkm

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-zft8k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-zft8k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-zft8k

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6ba1d9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-86dd79-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6ba1d9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-86dd79-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cgp5z

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 10.507s (10.507s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-v86jh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-82nzg

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-b58km

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-86dd79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-86dd79-975c67ddd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-86dd79-975c67ddd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-86dd79-975c67ddd-9fkvs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-86dd79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-86dd79-b646745d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-86dd79-b646745d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-cqsmb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-954773-6b46c87747-zb7xx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-954773-5974987546-jmjmm

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-86dd79-b646745d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-86dd79: serviceaccount "payload-processing-e2e-ipp-b-86dd79" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-86dd79-975c67ddd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-86dd79-975c67ddd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-86dd79: serviceaccount "payload-processing-e2e-ipp-b-86dd79" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-86dd79-975c67ddd-9fkvs

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dd79-975c67ddd-9fkvs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dd79-975c67ddd-9fkvs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-cqsmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-cqsmb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dd79-975c67ddd-9fkvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-n5lt5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-cqsmb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-cqsmb

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 10 to 6

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-ch68g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-xtvr4

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dc6rr

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-phk4s

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85

SuccessfulCreate

Created pod: e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

openshift-ingress

replicaset-controller

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85

SuccessfulCreate

Created pod: e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-86dd79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-86dd79-openshift-default-b5cd9fb85 from 4 to 6

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-86dd79-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-cqvsv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-flwpw

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 9 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-dhtt9
(x2)

openshift-ingress

kubelet

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-954773-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-954773-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

Unhealthy

Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

ProbeError

Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-tfvp7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-pzjz4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 10 to 6

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-jl2gx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-q68ld

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-356082-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-356082-openshift-default-7dd6879f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-356082

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-356082

openshift-ingress

replicaset-controller

e2e-api-b-356082-openshift-default-7dd6879f

SuccessfulCreate

Created pod: e2e-api-b-356082-openshift-default-7dd6879f-cf82h

openshift-ingress

multus

e2e-api-b-356082-openshift-default-7dd6879f-cf82h

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-954773

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-954773-c8cc8fb7b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-954773

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-954773-8bfd75f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-954773-c8cc8fb7b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-954773-c8cc8fb7b-kxfjn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-954773-8bfd75f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-kpldt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-954773-8bfd75f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-954773: serviceaccount "payload-processing-e2e-ipp-a-954773" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-954773-c8cc8fb7b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-954773-c8cc8fb7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-954773: serviceaccount "payload-processing-e2e-ipp-a-954773" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-kpldt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-954773-c8cc8fb7b-kxfjn

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-kpldt

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-kpldt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-kpldt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-954773-c8cc8fb7b-kxfjn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-954773-c8cc8fb7b-kxfjn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-954773-c8cc8fb7b-kxfjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-356082-6f945d9cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-356082-6f945d9cbc-w4tbx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-356082

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-356082-6f945d9cbc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-356082

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-356082-84fd4794fb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-356082-84fd4794fb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-356082-84fd4794fb-578fh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-356082-84fd4794fb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-356082-84fd4794fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-356082: serviceaccount "payload-processing-e2e-api-b-356082" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-356082-6f945d9cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-356082-6f945d9cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-356082: serviceaccount "payload-processing-e2e-api-b-356082" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-356082-84fd4794fb-578fh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-356082-6f945d9cbc-w4tbx

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-356082-84fd4794fb-578fh

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-356082-6f945d9cbc-w4tbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

Unhealthy

Readiness probe failed: Get "http://10.133.0.106:15021/healthz/ready": read tcp 10.133.0.2:32820->10.133.0.106:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-356082-6f945d9cbc-w4tbx

Created

Container created

openshift-ingress

kubelet

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

ProbeError

Readiness probe error: Get "http://10.133.0.106:15021/healthz/ready": read tcp 10.133.0.2:32820->10.133.0.106:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-356082-6f945d9cbc-w4tbx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-356082-84fd4794fb-578fh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-356082-84fd4794fb-578fh

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6ba1d9-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-b-6ba1d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6ba1d9-openshift-default-587457755f from 1 to 4

openshift-ingress

replicaset-controller

e2e-ipp-b-6ba1d9-openshift-default-587457755f

SuccessfulCreate

Created pod: e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

openshift-ingress

replicaset-controller

e2e-ipp-b-6ba1d9-openshift-default-587457755f

SuccessfulCreate

Created pod: e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

openshift-ingress

replicaset-controller

e2e-ipp-b-6ba1d9-openshift-default-587457755f

SuccessfulCreate

Created pod: e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

openshift-ingress

multus

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ba1d9-765d5dfb88-4djss

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ba1d9-7c9cdf8fc9-4874l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-145336

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-145336

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5c90f5-7ddb795695-mvdkm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5c90f5-5c75d4fcc6-zft8k

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-145336-openshift-default-8657b6985c

SuccessfulCreate

Created pod: e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

openshift-ingress

deployment-controller

e2e-ipp-b-145336-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-145336-openshift-default-8657b6985c from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

Unhealthy

Readiness probe failed: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

ProbeError

Readiness probe error: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b273b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b273b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-38bc0d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-38bc0d

openshift-ingress

deployment-controller

e2e-ipp-b-38bc0d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-38bc0d-openshift-default-58c74bbb77 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77

SuccessfulCreate

Created pod: e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc
(x7)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd098e-5d46cf4f46-fqj9c

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-145336

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-145336-5f79ffd9c4 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-145336-547c679c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-145336-547c679c5-t8nvr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-145336-547c679c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-145336-547c679c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-145336: serviceaccount "payload-processing-e2e-ipp-b-145336" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd098e-69b494c675-59gcp

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-145336

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-145336-547c679c5 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-145336-5f79ffd9c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-145336-5f79ffd9c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-145336: serviceaccount "payload-processing-e2e-ipp-b-145336" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-145336-5f79ffd9c4-z2vbr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-145336-5f79ffd9c4-z2vbr

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-145336-5f79ffd9c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-145336-5f79ffd9c4-z2vbr

openshift-ingress

multus

payload-processing-e2e-ipp-b-145336-5f79ffd9c4-z2vbr

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-145336-5f79ffd9c4-z2vbr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-145336-547c679c5-t8nvr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-145336-547c679c5-t8nvr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-145336-547c679c5-t8nvr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

Unhealthy

Startup probe failed: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

ProbeError

Startup probe error: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-145336-547c679c5-t8nvr

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-38bc0d: serviceaccount "payload-processing-e2e-ipp-b-38bc0d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-4d925

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-4d925

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-38bc0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-bd098e-openshift-default-8b546f85f-wlkf8

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-4d925

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-38bc0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-38bc0d: serviceaccount "payload-processing-e2e-ipp-b-38bc0d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-wd9mn

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-wd9mn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-4d925

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-wd9mn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-wd9mn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-wd9mn

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-4d925

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-356082-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-356082-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6ba1d9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6ba1d9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5c90f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5c90f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b273b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-954773-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b273b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-954773-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6ba1d9: serviceaccount "payload-processing-e2e-ipp-b-6ba1d9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-q6l9v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6ba1d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6ba1d9-dd777b898

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6ba1d9-dd777b898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6ba1d9: serviceaccount "payload-processing-e2e-ipp-b-6ba1d9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6ba1d9-dd777b898

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6ba1d9-dd777b898-2fzph

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6ba1d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6ba1d9-dd777b898 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ba1d9-dd777b898-2fzph

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ba1d9-dd777b898-2fzph

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ba1d9-dd777b898-2fzph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-6ba1d9-dd777b898-2fzph

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-q6l9v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-q6l9v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-q6l9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-q6l9v

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5c90f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5c90f5-74b8894498 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-zzn9d
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5c90f5: serviceaccount "payload-processing-e2e-ipp-a-5c90f5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5c90f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5c90f5-74b8894498

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5c90f5-74b8894498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5c90f5: serviceaccount "payload-processing-e2e-ipp-a-5c90f5" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-5c90f5-74b8894498-hx8v8

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5c90f5-74b8894498

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5c90f5-74b8894498-hx8v8

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-zzn9d

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-zzn9d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-zzn9d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5c90f5-74b8894498-hx8v8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-zzn9d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5c90f5-74b8894498-hx8v8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5c90f5-74b8894498-hx8v8

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-b-6ba1d9-openshift-default-587457755f

SuccessfulCreate

Created pod: e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6ba1d9-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

e2e-ipp-b-6ba1d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6ba1d9-openshift-default-587457755f from 4 to 5

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

Started

Container started

openshift-ingress

multus

e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

ProbeError

Startup probe error: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

Unhealthy

Startup probe failed: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dd79-975c67ddd-9fkvs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dd79-b646745d7-cqsmb

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5c90f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5c90f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-356082-openshift-default-7dd6879f-cf82h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-356082-openshift-default-7dd6879f-cf82h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-356082-openshift-default-7dd6879f-cf82h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-sthhc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-h9t2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-xnn87

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-356082-openshift-default-7dd6879f-cf82h

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-356082-openshift-default-7dd6879f-cf82h

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-k7v67

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-4wrpv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-95daa2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-95daa2

openshift-ingress

replicaset-controller

e2e-praxis-a-95daa2-openshift-default-656b88c449

SuccessfulCreate

Created pod: e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-praxis-a-95daa2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-95daa2-openshift-default-656b88c449 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-86dd79-openshift-default-b5cd9fb85-2k7nk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-b273b6-6bcd8bb886-4mhbb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b273b6-d5b5cd4bc-vp85w

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vj42t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-qz4gn

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-5cw4w

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hfrm

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-95daa2-56c855c684

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-95daa2-56c855c684-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-95daa2: serviceaccount "payload-processing-e2e-praxis-a-95daa2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-95daa2: serviceaccount "payload-processing-e2e-praxis-a-95daa2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-95daa2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-95daa2-56c855c684 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-95daa2-56c855c684

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-95daa2-56c855c684-r75r9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-95daa2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-x2h5b

openshift-ingress

multus

payload-processing-e2e-praxis-a-95daa2-56c855c684-r75r9

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-x2h5b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-x2h5b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-95daa2-56c855c684-r75r9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-95daa2-56c855c684-r75r9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-95daa2-56c855c684-r75r9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-x2h5b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-x2h5b

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-38bc0d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-38bc0d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-b273b6-openshift-default-55d489cc49-ffl76

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-145336-547c679c5-t8nvr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-145336-5f79ffd9c4-z2vbr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-38bc0d-5576b45767-4d925

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-38bc0d-6bcf449fcd-wd9mn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-356082-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-356082-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w

Unhealthy

Readiness probe failed: dial tcp 10.133.0.105:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7542fa-c4f7789b7-kxf7w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7542fa-5fff779d4-p5p5g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-356082-6f945d9cbc-w4tbx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-356082-84fd4794fb-578fh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-145336-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-145336-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

ProbeError

Startup probe error: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-7542fa-openshift-default-65c497d8b9-h9647

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

Unhealthy

Startup probe failed: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-145336

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-145336-7dbd64fd96 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-145336

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-145336-755cc54c67 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-145336-755cc54c67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-145336-755cc54c67-gdp9j

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-145336-755cc54c67-gdp9j

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-145336-7dbd64fd96

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-145336-7dbd64fd96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-145336: serviceaccount "payload-processing-e2e-ipp-b-145336" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-145336-755cc54c67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-145336-755cc54c67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-145336: serviceaccount "payload-processing-e2e-ipp-b-145336" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-145336-755cc54c67-gdp9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-145336-7dbd64fd96

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-145336-7dbd64fd96-hb742

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-145336-755cc54c67-gdp9j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-145336-755cc54c67-gdp9j

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-38bc0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-145336-7dbd64fd96-hb742

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-145336-7dbd64fd96-hb742

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-145336-7dbd64fd96-hb742

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-145336-7dbd64fd96-hb742

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-38bc0d: serviceaccount "payload-processing-e2e-ipp-b-38bc0d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-dv8mp

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-ng4qf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-38bc0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-38bc0d: serviceaccount "payload-processing-e2e-ipp-b-38bc0d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-dv8mp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-ng4qf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-ng4qf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-ng4qf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-ng4qf

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-dv8mp

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-dv8mp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-dv8mp

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-38bc0d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-38bc0d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ba1d9-dd777b898-2fzph

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ba1d9-5ddcc994b7-q6l9v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-356082-openshift-default-7dd6879f-cf82h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-168989-openshift-default-6c7887fd69

SuccessfulCreate

Created pod: e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

openshift-ingress

deployment-controller

e2e-ipp-a-168989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-168989-openshift-default-6c7887fd69 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-168989

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-168989

openshift-ingress

multus

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-zg4xn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-ppqx4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rpv8r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-rlcdv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-6ba1d9-openshift-default-587457755f-qzkrr

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-145336-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-a-70a069-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-70a069-openshift-default-c467dfd9c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-70a069

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-70a069

openshift-ingress

replicaset-controller

e2e-praxis-a-70a069-openshift-default-c467dfd9c

SuccessfulCreate

Created pod: e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-145336-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-168989-57776d77b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-168989-57776d77b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-168989: serviceaccount "payload-processing-e2e-ipp-a-168989" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-168989-5cfc8db7cd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-168989-5cfc8db7cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-168989: serviceaccount "payload-processing-e2e-ipp-a-168989" not found
(x2)

openshift-ingress

kubelet

e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-168989

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-168989-5cfc8db7cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-168989

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-168989-57776d77b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-168989-57776d77b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-168989-57776d77b7-zzmrl

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-168989-5cfc8db7cd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-168989-5cfc8db7cd-t522n
(x2)

openshift-ingress

kubelet

e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-b-ea4bc0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-168989-57776d77b7-zzmrl

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc

SuccessfulCreate

Created pod: e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ea4bc0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ea4bc0

openshift-ingress

multus

payload-processing-e2e-ipp-a-168989-5cfc8db7cd-t522n

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-168989-5cfc8db7cd-t522n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-168989-57776d77b7-zzmrl

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-70a069

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-70a069-588bb4c774 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-168989-57776d77b7-zzmrl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-168989-5cfc8db7cd-t522n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-168989-5cfc8db7cd-t522n

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-70a069-588bb4c774

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-70a069-588bb4c774-k8f7k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-70a069

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-168989-57776d77b7-zzmrl

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-70a069: serviceaccount "payload-processing-e2e-praxis-a-70a069" not found

openshift-ingress

multus

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-cjrm2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-70a069-588bb4c774

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-70a069-588bb4c774-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-70a069: serviceaccount "payload-processing-e2e-praxis-a-70a069" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-cjrm2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-70a069-588bb4c774-k8f7k

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-cjrm2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-cjrm2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-cjrm2

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-70a069-588bb4c774-k8f7k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-70a069-588bb4c774-k8f7k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-70a069-588bb4c774-k8f7k

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zghmk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-kf6tq

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75d7c785f from 10 to 7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-zghmk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-kf6tq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-95daa2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-sdrx5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-95daa2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-sdrx5
(x6)

openshift-ingress

kubelet

e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ea4bc0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ea4bc0: serviceaccount "payload-processing-e2e-praxis-b-ea4bc0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-mz5mb

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ea4bc0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ea4bc0: serviceaccount "payload-processing-e2e-praxis-b-ea4bc0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-wgcm7

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-mz5mb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-mz5mb

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-wgcm7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-wgcm7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-mz5mb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-wgcm7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-wgcm7

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-mz5mb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-954773-8bfd75f5-kpldt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-954773-c8cc8fb7b-kxfjn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-954773-openshift-default-f9885dc7-ln5js

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-38bc0d-7cccb6849f-dv8mp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-38bc0d-7cd6f977b4-ng4qf

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-95daa2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-95daa2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-38bc0d-openshift-default-58c74bbb77-b7csc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-2979be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-2979be

openshift-ingress

deployment-controller

e2e-praxis-a-2979be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-2979be-openshift-default-5d449c749 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-2979be-openshift-default-5d449c749

SuccessfulCreate

Created pod: e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

openshift-ingress

multus

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-168989-5cfc8db7cd-t522n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-168989-57776d77b7-zzmrl

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-2979be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-2979be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-2979be-6c69bc79fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2979be: serviceaccount "payload-processing-e2e-praxis-a-2979be" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2979be-6c69bc79fb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-2979be-6c69bc79fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2979be: serviceaccount "payload-processing-e2e-praxis-a-2979be" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2979be-6c69bc79fb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-b-003ec6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-003ec6-openshift-default-74dcb8dd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-003ec6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-003ec6

openshift-ingress

replicaset-controller

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9

SuccessfulCreate

Created pod: e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

openshift-ingress

multus

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-70a069-openshift-default-c467dfd9c

SuccessfulCreate

Created pod: e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

openshift-ingress

replicaset-controller

e2e-praxis-a-70a069-openshift-default-c467dfd9c

SuccessfulCreate

Created pod: e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-70a069-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-70a069-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-70a069-openshift-default-c467dfd9c from 1 to 3

openshift-ingress

multus

e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

ProbeError

Readiness probe error: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

Unhealthy

Readiness probe failed: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

ProbeError

Startup probe error: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

Unhealthy

Startup probe failed: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-168989

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-168989-7495c56bd from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-168989-7495c56bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-168989-7495c56bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-168989: serviceaccount "payload-processing-e2e-ipp-a-168989" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-168989-55fbb7b799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-168989: serviceaccount "payload-processing-e2e-ipp-a-168989" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-168989-7495c56bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-168989-7495c56bd-gpdbf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-168989

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-168989-55fbb7b799 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-168989-7495c56bd-gpdbf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-168989-7495c56bd-gpdbf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-n85cs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-n85cs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-168989-7495c56bd-gpdbf

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-168989-55fbb7b799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-n85cs

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-n85cs

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-168989-7495c56bd-gpdbf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-n85cs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-003ec6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-003ec6-58c5d44fbd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-003ec6: serviceaccount "payload-processing-e2e-praxis-b-003ec6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-003ec6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-003ec6-58c5d44fbd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-003ec6: serviceaccount "payload-processing-e2e-praxis-b-003ec6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-003ec6-58c5d44fbd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-m47lr

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-m47lr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-m47lr

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-168989-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-168989-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-n8t27

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-n8t27

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-n8t27

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-n8t27

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-n8t27

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-m47lr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-m47lr

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-70a069-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-70a069-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-95daa2-56c855c684-r75r9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-95daa2-57d55b5647-x2h5b

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ea4bc0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ea4bc0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0f3cd8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0f3cd8

openshift-ingress

deployment-controller

e2e-ipp-b-0f3cd8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5

SuccessfulCreate

Created pod: e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

openshift-ingress

multus

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-168989-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-168989-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-70a069-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0f3cd8: serviceaccount "payload-processing-e2e-ipp-b-0f3cd8" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-70a069-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-kbs5c

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0f3cd8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-zks77

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0f3cd8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0f3cd8: serviceaccount "payload-processing-e2e-ipp-b-0f3cd8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-kbs5c

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-kbs5c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-kbs5c

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-zks77

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-zks77

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-zks77

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-zks77

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-kbs5c

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ea4bc0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ea4bc0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-95daa2-openshift-default-656b88c449-9vb6h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2979be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2979be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-b-3ad281-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-3ad281-openshift-default-9d85cfb97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-3ad281

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-3ad281
(x5)

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-b-3ad281-openshift-default-9d85cfb97

SuccessfulCreate

Created pod: e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s
(x5)

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:

openshift-ingress

multus

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-9tdgg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-3ad281

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3ad281-7cdfb786fb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3ad281: serviceaccount "payload-processing-e2e-praxis-b-3ad281" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-3ad281

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-3ad281-7cdfb786fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3ad281: serviceaccount "payload-processing-e2e-praxis-b-3ad281" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3ad281-7cdfb786fb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-xls4z

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-9tdgg

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-xls4z

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-9tdgg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-9tdgg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-9tdgg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-xls4z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-xls4z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-xls4z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ea4bc0-6b47d8d584-wgcm7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ea4bc0-7d5858859-mz5mb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

ProbeError

Readiness probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

Unhealthy

Readiness probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2979be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2979be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-70a069-84d89c7cff-cjrm2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-70a069-588bb4c774-k8f7k

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3ad281-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3ad281-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-ea4bc0-openshift-default-7db8b979fc-6f88f

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0f3cd8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0f3cd8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f3cd8-69f455dc4b-zks77

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f3cd8-788765798c-kbs5c

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-003ec6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-003ec6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-24wr6

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4fcj7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 6 to 4

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-dxv49

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-zcj7n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qk7z2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wd2rz
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-dp4ct

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-l86vl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-zgl9n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-70a069-openshift-default-c467dfd9c-fhgfb

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0f3cd8-55989f95fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-rn9ld
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0f3cd8: serviceaccount "payload-processing-e2e-ipp-b-0f3cd8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-xqjsc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0f3cd8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0f3cd8-55989f95fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0f3cd8: serviceaccount "payload-processing-e2e-ipp-b-0f3cd8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0f3cd8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0f3cd8-55989f95fb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-xqjsc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-rn9ld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-rn9ld

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-rn9ld

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-xqjsc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-xqjsc

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-rn9ld

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-xqjsc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-003ec6-84bbd7b97f-n8t27

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-003ec6-58c5d44fbd-m47lr

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-kmr25

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0f3cd8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0f3cd8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-003ec6-openshift-default-74dcb8dd9-kw6rm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5c90f5-74b8894498-hx8v8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5c90f5-d4cb4bf67-zzn9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3ad281-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3ad281-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-5c90f5-openshift-default-6876c6b675-lbxpf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

Created

Container created

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 4 to 8

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

Created

Container created

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 5 to 9

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

Unhealthy

Startup probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

ProbeError

Startup probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-168989-7495c56bd-gpdbf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-168989-55fbb7b799-n85cs

Killing

Stopping container payload-pre-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

Unhealthy

Startup probe failed: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

ProbeError

Startup probe error: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

Unhealthy

Startup probe failed: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

ProbeError

Startup probe error: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-145336-7dbd64fd96-hb742

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-145336-755cc54c67-gdp9j

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

Created

Container created

openshift-ingress

multus

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulCreate

Created pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-168989-openshift-default-6c7887fd69-5g8qr

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-bt6gz

openshift-ingress

kubelet

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bt6gz

Killing

Stopping container discovery
(x3)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-145336-openshift-default-8657b6985c-dkvjx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-428529-openshift-default-5d4449bf97

SuccessfulCreate

Created pod: e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

openshift-ingress

deployment-controller

e2e-praxis-a-428529-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-428529-openshift-default-5d4449bf97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-428529

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-428529

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-428529

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-428529-6b49dc7d56 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-428529-8679b59df9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-428529-8679b59df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-428529: serviceaccount "payload-processing-e2e-praxis-a-428529" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-428529-8679b59df9-4nfl5

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-428529-8679b59df9-4nfl5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-428529-8679b59df9-4nfl5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-428529-8679b59df9-4nfl5

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-428529-8679b59df9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-428529-8679b59df9-4nfl5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-428529-6b49dc7d56

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-428529-6b49dc7d56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-428529: serviceaccount "payload-processing-e2e-praxis-a-428529" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-428529-6b49dc7d56

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-428529-6b49dc7d56-9nrst

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-428529

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-428529-8679b59df9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-428529-6b49dc7d56-9nrst

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-428529-6b49dc7d56-9nrst

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-428529-6b49dc7d56-9nrst

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-428529-6b49dc7d56-9nrst

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f3cd8-55989f95fb-rn9ld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f3cd8-54fd699959-xqjsc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-0f3cd8-openshift-default-55c4fc49b5-vdjbv

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 9 to 10

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-b4a561-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b4a561-openshift-default-65f79b4c6f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b4a561

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b4a561

openshift-ingress

replicaset-controller

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f

SuccessfulCreate

Created pod: e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

openshift-ingress

multus

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b4a561-5c6655468

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b4a561-5c6655468-48jfm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b4a561: serviceaccount "payload-processing-e2e-praxis-b-b4a561" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b4a561-5c6655468

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b4a561-5c6655468-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b4a561: serviceaccount "payload-processing-e2e-praxis-b-b4a561" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b4a561

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b4a561

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b4a561-5c6655468 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-h5vlz

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b4a561-5c6655468-48jfm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b4a561-5c6655468-48jfm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-h5vlz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-b4a561-5c6655468-48jfm

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-h5vlz

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-h5vlz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b4a561-5c6655468-48jfm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-h5vlz

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

Started

Container started

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

Created

Container created

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w4-4153e5-openshift-default-d76468489

SuccessfulCreate

Created pod: e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-4153e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-4153e5

openshift-ingress

deployment-controller

e2e-shared-a-w4-4153e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-4153e5-openshift-default-d76468489 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

Unhealthy

Readiness probe failed: Get "http://10.133.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-428529-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

ProbeError

Readiness probe error: Get "http://10.133.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-428529-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

Unhealthy

Readiness probe failed: Get "http://10.134.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

ProbeError

Readiness probe error: Get "http://10.134.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-4153e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-4153e5-b59c4f658 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-4153e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nw522

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75d7c785f from 7 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-nw522
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-4153e5: serviceaccount "payload-processing-e2e-shared-a-w4-4153e5" not found
(x7)

openshift-ingress

kubelet

e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

Unhealthy

Startup probe failed: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

ProbeError

Startup probe error: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-4153e5: serviceaccount "payload-processing-e2e-shared-a-w4-4153e5" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47

SuccessfulCreate

Created pod: e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

openshift-ingress

deployment-controller

e2e-shared-a-w0-2819d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-2819d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-2819d2

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r

Created

Container created
(x10)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2979be-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-2979be-openshift-default-5d449c749

SuccessfulCreate

Created pod: e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulCreate

Created pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

openshift-ingress

deployment-controller

e2e-praxis-a-2979be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-2979be-openshift-default-5d449c749 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-2819d2: serviceaccount "payload-processing-e2e-shared-a-w0-2819d2" not found

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

Started

Container started

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-2819d2: serviceaccount "payload-processing-e2e-shared-a-w0-2819d2" not found

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-2819d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-2819d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb from 0 to 1

openshift-ingress

multus

e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

ProbeError

Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

Unhealthy

Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

Unhealthy

Startup probe failed: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

ProbeError

Startup probe error: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4153e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-24fb97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-24fb97

openshift-ingress

replicaset-controller

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf

SuccessfulCreate

Created pod: e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

openshift-ingress

deployment-controller

e2e-shared-a-w3-24fb97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b4a561-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4153e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b4a561-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-428529-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-428529-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-24fb97: serviceaccount "payload-processing-e2e-shared-a-w3-24fb97" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-24fb97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-24fb97: serviceaccount "payload-processing-e2e-shared-a-w3-24fb97" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-24fb97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75d7c785f from 6 to 5

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-gjlm2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-gjlm2

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-gjlm2

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-428529-8679b59df9-4nfl5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-gjlm2

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-428529-6b49dc7d56-9nrst

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-17e747

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-17e747

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

openshift-ingress

deployment-controller

e2e-shared-b-w4-17e747-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-17e747-openshift-default-6bfc467795 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-17e747-openshift-default-6bfc467795

SuccessfulCreate

Created pod: e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-5p677

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2979be-d6d4dd6cf-jls4v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2979be-6c69bc79fb-89z4j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-17e747: serviceaccount "payload-processing-e2e-shared-b-w4-17e747" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8

openshift-ingress

replicaset-controller

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65

SuccessfulCreate

Created pod: e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-9a1cd0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-9a1cd0
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-17e747: serviceaccount "payload-processing-e2e-shared-b-w4-17e747" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-17e747

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w0-9a1cd0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-17e747

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-17e747-6c68bf6668 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b4a561-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b4a561-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-9a1cd0: serviceaccount "payload-processing-e2e-shared-b-w0-9a1cd0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-9a1cd0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-9a1cd0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-9a1cd0: serviceaccount "payload-processing-e2e-shared-b-w0-9a1cd0" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-2819d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-2819d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-428529-openshift-default-5d4449bf97-9rwk6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-fbz48

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

Unhealthy

Startup probe failed: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

ProbeError

Startup probe error: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-2979be-openshift-default-5d449c749-4t7td

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

Unhealthy

Readiness probe failed: Get "http://10.133.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

ProbeError

Readiness probe error: Get "http://10.133.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b4a561-89c7c457f-h5vlz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b4a561-5c6655468-48jfm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3ad281-5747c794bc-9tdgg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3ad281-7cdfb786fb-xls4z

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-2819d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-2819d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-594253

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-594253

openshift-ingress

deployment-controller

e2e-shared-b-w3-594253-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-594253-openshift-default-fc44dff6c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-594253-openshift-default-fc44dff6c

SuccessfulCreate

Created pod: e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

openshift-ingress

multus

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

ProbeError

Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

Unhealthy

Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-24fb97-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-24fb97-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-594253

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-594253-67c8c9db64 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-594253

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 4 to 3

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-594253: serviceaccount "payload-processing-e2e-shared-b-w3-594253" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-594253-67c8c9db64

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-594253-67c8c9db64

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-594253-67c8c9db64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-594253: serviceaccount "payload-processing-e2e-shared-b-w3-594253" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-2t5kt

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

ProbeError

Readiness probe error: Get "http://10.133.0.123:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3ad281-openshift-default-9d85cfb97-vjd8s

Unhealthy

Readiness probe failed: Get "http://10.133.0.123:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-24fb97-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-24fb97-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-b4a561-openshift-default-65f79b4c6f-mnltv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff

SuccessfulCreate

Created pod: e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-584ec5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-584ec5

openshift-ingress

deployment-controller

e2e-shared-a-w2-584ec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-584ec5: serviceaccount "payload-processing-e2e-shared-a-w2-584ec5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-584ec5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-584ec5: serviceaccount "payload-processing-e2e-shared-a-w2-584ec5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-584ec5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

Unhealthy

Readiness probe failed: Get "http://10.134.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

Unhealthy

Readiness probe failed: Get "http://10.133.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

ProbeError

Readiness probe error: Get "http://10.133.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

ProbeError

Readiness probe error: Get "http://10.134.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-autores-a1028d-openshift-default-98b848cc5

SuccessfulCreate

Created pod: e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

openshift-ingress

gateway_labeler_controller

e2e-autores-a1028d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-a1028d

openshift-ingress

deployment-controller

e2e-autores-a1028d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-a1028d-openshift-default-98b848cc5 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

Created

Container created

openshift-ingress

multus

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-autores-a1028d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-a1028d-7f6d45d596 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a1028d-7f6d45d596

FailedCreate

Error creating: pods "payload-processing-e2e-autores-a1028d-7f6d45d596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a1028d: serviceaccount "payload-processing-e2e-autores-a1028d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-a1028d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-a1028d-5747ccb875 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a1028d-5747ccb875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-a1028d-5747ccb875-vxckc
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

ProbeError

Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-a1028d-7f6d45d596-c5x65

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-a1028d-7f6d45d596-c5x65

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a1028d-5747ccb875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-a1028d-5747ccb875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a1028d: serviceaccount "payload-processing-e2e-autores-a1028d" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-a1028d-7f6d45d596-c5x65

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-a1028d-5747ccb875-vxckc

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a1028d-7f6d45d596

SuccessfulCreate

Created pod: payload-processing-e2e-autores-a1028d-7f6d45d596-c5x65
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

ProbeError

Startup probe error: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

Unhealthy

Startup probe failed: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1028d-5747ccb875-vxckc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

Unhealthy

Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-autores-a1028d-7f6d45d596-c5x65

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1028d-5747ccb875-vxckc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1028d-5747ccb875-vxckc

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9a1cd0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9a1cd0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-17e747-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-17e747-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

Started

Container started

openshift-ingress

multus

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulCreate

Created pod: e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9a1cd0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

Unhealthy

Readiness probe failed: Get "http://10.134.0.184:15021/healthz/ready": read tcp 10.134.0.2:51270->10.134.0.184:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

ProbeError

Readiness probe error: Get "http://10.134.0.184:15021/healthz/ready": read tcp 10.134.0.2:51270->10.134.0.184:15021: read: connection reset by peer body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-9a1cd0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-17e747-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-17e747-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4153e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4153e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-01a9cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-01a9cd

openshift-ingress

replicaset-controller

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c

SuccessfulCreate

Created pod: e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

openshift-ingress

deployment-controller

e2e-shared-b-w2-01a9cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-a1028d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-a1028d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-01a9cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-01a9cd: serviceaccount "payload-processing-e2e-shared-b-w2-01a9cd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-01a9cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-01a9cd: serviceaccount "payload-processing-e2e-shared-b-w2-01a9cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

ProbeError

Readiness probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

Unhealthy

Readiness probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-594253-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-594253-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

ProbeError

Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

Unhealthy

Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-584ec5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-584ec5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fl6gr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-fl6gr
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-584ec5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-584ec5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-01a9cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-01a9cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w3-594253-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-594253-openshift-default-fc44dff6c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-594253-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

Started

Container started

openshift-ingress

multus

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-594253-openshift-default-fc44dff6c

SuccessfulCreate

Created pod: e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-01a9cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-01a9cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-autores-a1028d-7f6d45d596-c5x65

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1028d-5747ccb875-vxckc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2v7dx

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-jwhdt

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-vpdwp

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-a1028d-openshift-default-98b848cc5-7gbg5

ProbeError

Startup probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-noten-069e90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-069e90-openshift-default-56f7865fdc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-069e90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-069e90

openshift-ingress

replicaset-controller

e2e-noten-069e90-openshift-default-56f7865fdc

SuccessfulCreate

Created pod: e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

openshift-ingress

multus

e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

Started

Container started

openshift-ingress

kubelet

e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-dh29k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-069e90-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-069e90-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-069e90-openshift-default-56f7865fdc-g4wvw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

opendatahub

multus

test-curl-11187-b5249c

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-11187-b5249c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11187-b5249c

Created

Container created

opendatahub

kubelet

test-curl-11187-b5249c

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-hr59j

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-22z9q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-3a00b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-3a00b8

openshift-ingress

deployment-controller

e2e-shared-a-w1-3a00b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc

SuccessfulCreate

Created pod: e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

opendatahub

multus

test-curl-11196-456950

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11196-456950

Started

Container started

opendatahub

kubelet

test-curl-11196-456950

Created

Container created

opendatahub

kubelet

test-curl-11196-456950

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11187-b5249c

Killing

Stopping container test-curl-11187-b5249c

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-fdwmt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-p9rww

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-11196-01ba21

Started

Container started

opendatahub

kubelet

test-curl-11196-456950

Killing

Stopping container test-curl-11196-456950

opendatahub

multus

test-curl-11196-01ba21

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11196-01ba21

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11196-01ba21

Created

Container created

opendatahub

kubelet

test-curl-11196-6de19d

Started

Container started

opendatahub

multus

test-curl-11196-6de19d

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11196-6de19d

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-3a00b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-8tg6k
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-3a00b8: serviceaccount "payload-processing-e2e-shared-a-w1-3a00b8" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-3a00b8: serviceaccount "payload-processing-e2e-shared-a-w1-3a00b8" not found

opendatahub

kubelet

test-curl-11196-01ba21

Killing

Stopping container test-curl-11196-01ba21

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-3a00b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-cg5r9

opendatahub

kubelet

test-curl-11196-6de19d

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-cg5r9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-cg5r9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-8tg6k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-cg5r9

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-8tg6k

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-8tg6k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-8tg6k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-cg5r9

Created

Container created

opendatahub

kubelet

test-curl-11196-532d8a

Created

Container created

opendatahub

kubelet

test-curl-11196-532d8a

Started

Container started

opendatahub

kubelet

test-curl-11196-532d8a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11196-532d8a

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11196-6de19d

Killing

Stopping container test-curl-11196-6de19d

opendatahub

kubelet

test-curl-11196-532d8a

Killing

Stopping container test-curl-11196-532d8a

opendatahub

multus

test-curl-11196-bc3f78

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11196-bc3f78

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11196-bc3f78

Started

Container started

opendatahub

kubelet

test-curl-11196-bc3f78

Created

Container created

opendatahub

kubelet

test-curl-11196-bc3f78

Killing

Stopping container test-curl-11196-bc3f78

openshift-ingress

replicaset-controller

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7

SuccessfulCreate

Created pod: e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

openshift-ingress

multus

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-58fad4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-58fad4

openshift-ingress

deployment-controller

e2e-extmod-a-58fad4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-58fad4-openshift-default-7d558dc9c7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-58fad4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-58fad4-75547c5dfb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-58fad4-75547c5dfb

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-58fad4-75547c5dfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-58fad4: serviceaccount "payload-processing-e2e-extmod-a-58fad4" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-58fad4: serviceaccount "payload-processing-e2e-extmod-a-58fad4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-58fad4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-58fad4-75547c5dfb

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s46k5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-8gkht

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

(combined from similar events): New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-hxpx4
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 6 to 5

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-m8dlv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-a0fc73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a0fc73-openshift-default-c964896bf from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-a0fc73-openshift-default-c964896bf

SuccessfulCreate

Created pod: e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-a0fc73

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a0fc73

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7l9sb

openshift-ingress

multus

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-a0fc73

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-a0fc73

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d from 0 to 1

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75d7c785f from 4 to 3

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-wwmvn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-8pw9h
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 7 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-8pw9h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a0fc73: serviceaccount "payload-processing-e2e-extmod-a-a0fc73" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a0fc73: serviceaccount "payload-processing-e2e-extmod-a-a0fc73" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f

SuccessfulCreate

Created pod: e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

openshift-ingress

deployment-controller

e2e-extmod-a-6b8bfa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6b8bfa-openshift-default-7fc555776f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-6b8bfa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6b8bfa

openshift-ingress

multus

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w1-a0684f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-a0684f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-a0684f

openshift-ingress

replicaset-controller

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc

SuccessfulCreate

Created pod: e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

openshift-ingress

multus

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

ProbeError

Startup probe error: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

Unhealthy

Startup probe failed: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6b8bfa: serviceaccount "payload-processing-e2e-extmod-a-6b8bfa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-6b8bfa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-6b8bfa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-mh9c9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6b8bfa: serviceaccount "payload-processing-e2e-extmod-a-6b8bfa" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-mh9c9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-mh9c9

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-mh9c9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-mh9c9

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-a0684f: serviceaccount "payload-processing-e2e-shared-b-w1-a0684f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-a0684f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-a0684f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-25wf9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-a0684f: serviceaccount "payload-processing-e2e-shared-b-w1-a0684f" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-25wf9

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-25wf9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-25wf9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-25wf9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.26s (2.26s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-29mqs
(x4)

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 6 to 4

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-jfwzj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-3a00b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-3a00b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-93ec46-openshift-default-8d6db8b57

SuccessfulCreate

Created pod: e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

openshift-ingress

deployment-controller

e2e-extmod-b-93ec46-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-93ec46-openshift-default-8d6db8b57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-93ec46

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-93ec46
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 6 to 4

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-s2zsh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-93ec46

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-93ec46-7bb6f559fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-93ec46: serviceaccount "payload-processing-e2e-extmod-b-93ec46" not found

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-fxmw9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-93ec46: serviceaccount "payload-processing-e2e-extmod-b-93ec46" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-93ec46

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-a0684f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-3a00b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-a0684f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-3a00b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr
(x6)

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused
(x4)

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 4 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9

SuccessfulCreate

Created pod: e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0fdc4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0fdc4e

openshift-ingress

deployment-controller

e2e-extmod-b-0fdc4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-2vdsr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-btgq2

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0fdc4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0fdc4e: serviceaccount "payload-processing-e2e-extmod-b-0fdc4e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0fdc4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-58fad4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0fdc4e: serviceaccount "payload-processing-e2e-extmod-b-0fdc4e" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-58fad4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz

openshift-ingress

multus

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a0fc73-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a0fc73-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-58fad4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-58fad4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

test-curl-11190-2f177e

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11190-2f177e

Created

Container created

opendatahub

kubelet

test-curl-11190-2f177e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11190-2f177e

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a0fc73-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a0fc73-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-11190-2f177e

Killing

Stopping container test-curl-11190-2f177e

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

Unhealthy

Readiness probe failed: Get "http://10.133.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

ProbeError

Readiness probe error: Get "http://10.133.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

Unhealthy

Readiness probe failed: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

ProbeError

Readiness probe error: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-46t2r
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-46t2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-2hnph

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-46t2r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-46t2r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc

SuccessfulCreate

Created pod: e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-9dfb3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-9dfb3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-9dfb3c

openshift-ingress

multus

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

ProbeError

Startup probe error: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

Unhealthy

Startup probe failed: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6b8bfa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-a-0ce950-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-0ce950-openshift-default-88864987c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-0ce950-openshift-default-88864987c

SuccessfulCreate

Created pod: e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-0ce950

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-0ce950
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6b8bfa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-9dfb3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9dfb3c: serviceaccount "payload-processing-e2e-extmod-b-9dfb3c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9dfb3c: serviceaccount "payload-processing-e2e-extmod-b-9dfb3c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-9dfb3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0ce950-5db457fb88

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-0ce950-5db457fb88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0ce950: serviceaccount "payload-processing-e2e-extmod-a-0ce950" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0ce950-5db457fb88

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0ce950: serviceaccount "payload-processing-e2e-extmod-a-0ce950" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-0ce950

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-0ce950

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-0ce950-5db457fb88 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-a0684f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-a0684f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-explicit-9bf0e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-9bf0e2-openshift-default-59c74b64b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-9bf0e2-openshift-default-59c74b64b9

SuccessfulCreate

Created pod: e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

openshift-ingress

gateway_labeler_controller

e2e-explicit-9bf0e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-9bf0e2

openshift-ingress

multus

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-9bf0e2: serviceaccount "payload-processing-e2e-explicit-9bf0e2" not found

openshift-ingress

kubelet

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

Unhealthy

Readiness probe failed: Get "http://10.133.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-9bf0e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-9bf0e2-7dd576c498 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-9bf0e2-7dd576c498

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-9bf0e2-7dd576c498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-9bf0e2: serviceaccount "payload-processing-e2e-explicit-9bf0e2" not found

openshift-ingress

kubelet

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

ProbeError

Readiness probe error: Get "http://10.133.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-9bf0e2-7dd576c498

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-9bf0e2-7dd576c498-rlxz6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-g88g6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-9bf0e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-g88g6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-9bf0e2-7dd576c498-rlxz6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-9bf0e2-7dd576c498-rlxz6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-g88g6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-g88g6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-9bf0e2-7dd576c498-rlxz6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-9bf0e2-7dd576c498-rlxz6

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-g88g6

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6b8bfa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6b8bfa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

ProbeError

Startup probe error: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

Unhealthy

Startup probe failed: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

Unhealthy

Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

ProbeError

Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-93ec46-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-93ec46-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0fdc4e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0fdc4e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0fdc4e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0fdc4e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

ProbeError

Readiness probe error: Get "http://10.133.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

Unhealthy

Readiness probe failed: Get "http://10.133.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-93ec46-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-93ec46-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp

Unhealthy

Startup probe failed: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp

ProbeError

Startup probe error: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

ProbeError

Startup probe error: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

Unhealthy

Startup probe failed: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-000edd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-000edd-openshift-default-6dfb97cbcc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-000edd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-000edd

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-fqmxh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc

SuccessfulCreate

Created pod: e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0ce950-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0ce950-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-000edd-64d8869796

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-000edd-64d8869796

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-000edd-64d8869796-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-000edd: serviceaccount "payload-processing-e2e-extmod-b-000edd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-000edd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-000edd-64d8869796 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-000edd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-000edd: serviceaccount "payload-processing-e2e-extmod-b-000edd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0ce950-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0ce950-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

Unhealthy

Readiness probe failed: Get "http://10.133.0.200:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

ProbeError

Readiness probe error: Get "http://10.133.0.200:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

Created

Container created
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9dfb3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9dfb3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

ProbeError

Startup probe error: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

Unhealthy

Startup probe failed: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-9bf0e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-9bf0e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-9bf0e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-9bf0e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

Unhealthy

Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

ProbeError

Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-9bf0e2-7dd576c498-rlxz6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9bf0e2-57b5f85fdc-g88g6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-000edd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-000edd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-95f40f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-95f40f

openshift-ingress

multus

e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-95f40f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-95f40f-openshift-default-c68d485cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-95f40f-openshift-default-c68d485cc

SuccessfulCreate

Created pod: e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-9bf0e2-openshift-default-59c74b64b9-47xt2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-95f40f: serviceaccount "payload-processing-e2e-extmod-a-95f40f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-95f40f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-95f40f: serviceaccount "payload-processing-e2e-extmod-a-95f40f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-95f40f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7

AddedInterface

Add eth0 [10.134.0.220/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2

Started

Container started

openshift-ingress

multus

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-58fad4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-58fad4-openshift-default-7d558dc9c7 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7

SuccessfulCreate

Created pod: e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-58fad4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-6b8bfa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6b8bfa-openshift-default-7fc555776f from 1 to 2

openshift-ingress

multus

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6b8bfa-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f

SuccessfulCreate

Created pod: e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

Unhealthy

Startup probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

ProbeError

Startup probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

ProbeError

Startup probe error: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

Unhealthy

Startup probe failed: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9dfb3c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-9dfb3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc

SuccessfulCreate

Created pod: e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-95f40f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-95f40f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c

SuccessfulCreate

Created pod: e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

openshift-ingress

deployment-controller

e2e-extmod-b-2c4b44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2c4b44

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2c4b44

openshift-ingress

multus

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

ProbeError

Startup probe error: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

Unhealthy

Startup probe failed: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2c4b44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2c4b44-76d85598d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2c4b44-76d85598d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2c4b44-76d85598d-jznf4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2c4b44: serviceaccount "payload-processing-e2e-extmod-b-2c4b44" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2c4b44-76d85598d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2c4b44-76d85598d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2c4b44: serviceaccount "payload-processing-e2e-extmod-b-2c4b44" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2c4b44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-4q2rj

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-4q2rj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-2c4b44-76d85598d-jznf4

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2c4b44-76d85598d-jznf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2c4b44-76d85598d-jznf4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2c4b44-76d85598d-jznf4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-4q2rj

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-4q2rj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-4q2rj

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-95f40f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-95f40f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

replicaset-controller

payload-processing-external-model-565954b4c8

SuccessfulCreate

Created pod: payload-processing-external-model-565954b4c8-xdflc

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-565954b4c8 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-565954b4c8

FailedCreate

Error creating: pods "payload-processing-external-model-565954b4c8-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-565954b4c8-xdflc

Started

Container started

models-as-a-service

multus

payload-processing-external-model-565954b4c8-xdflc

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-565954b4c8-xdflc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-565954b4c8-xdflc

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-ssskh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-2wbd7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2wbd7

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-2wbd7

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ssskh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ssskh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ssskh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2wbd7

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-ssskh

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2wbd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2wbd7

Unhealthy

Startup probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2wbd7

ProbeError

Startup probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ssskh

Unhealthy

Startup probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ssskh

ProbeError

Startup probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-rt6p2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-jhqft

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-rgk4t
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 8; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-72kzd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-72kzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-72kzd

AddedInterface

Add eth0 [10.134.0.226/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-rt6p2

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rt6p2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rgk4t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-72kzd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-72kzd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rgk4t

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rgk4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rt6p2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-jhqft

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-jhqft

AddedInterface

Add eth0 [10.133.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-jhqft

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rt6p2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-rgk4t

AddedInterface

Add eth0 [10.134.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-jhqft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rt6p2

Unhealthy

Startup probe failed: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rt6p2

ProbeError

Startup probe error: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rgk4t

ProbeError

Startup probe error: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-72kzd

Unhealthy

Startup probe failed: Get "http://10.134.0.226:15021/healthz/ready": dial tcp 10.134.0.226:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rgk4t

Unhealthy

Startup probe failed: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-72kzd

ProbeError

Startup probe error: Get "http://10.134.0.226:15021/healthz/ready": dial tcp 10.134.0.226:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-jhqft

Unhealthy

Startup probe failed: Get "http://10.133.0.226:15021/healthz/ready": dial tcp 10.133.0.226:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-jhqft

ProbeError

Startup probe error: Get "http://10.133.0.226:15021/healthz/ready": dial tcp 10.133.0.226:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-g55b2
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x4)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-75d7c785f from 8 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-fpsp7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-g55b2

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-fpsp7

AddedInterface

Add eth0 [10.133.0.229/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-565954b4c8-xdflc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-g55b2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-g55b2

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-g55b2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fpsp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fpsp7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fpsp7

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5db9b8ddc4 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5db9b8ddc4

FailedCreate

Error creating: pods "payload-processing-external-model-5db9b8ddc4-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5db9b8ddc4

SuccessfulCreate

Created pod: payload-processing-external-model-5db9b8ddc4-psvgz
(x7)

openshift-ingress

kubelet

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

ProbeError

Startup probe error: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-5db9b8ddc4-psvgz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5db9b8ddc4-psvgz

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5db9b8ddc4-psvgz

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5db9b8ddc4-psvgz

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

Unhealthy

Startup probe failed: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-g55b2

ProbeError

Startup probe error: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-5db9b8ddc4-psvgz

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-g55b2

Unhealthy

Startup probe failed: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fpsp7

ProbeError

Startup probe error: Get "http://10.133.0.229:15021/healthz/ready": dial tcp 10.133.0.229:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2c4b44-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2c4b44-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fpsp7

Unhealthy

Startup probe failed: Get "http://10.133.0.229:15021/healthz/ready": dial tcp 10.133.0.229:15021: connect: connection refused
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5db9b8ddc4

FailedCreate

Error creating: pods "payload-processing-external-model-5db9b8ddc4-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5db9b8ddc4 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-5db9b8ddc4-mxg9x

AddedInterface

Add eth0 [10.134.0.229/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5db9b8ddc4-mxg9x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5db9b8ddc4-mxg9x

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5db9b8ddc4-mxg9x

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-5db9b8ddc4

SuccessfulCreate

Created pod: payload-processing-external-model-5db9b8ddc4-mxg9x

models-as-a-service

kubelet

payload-processing-external-model-5db9b8ddc4-mxg9x

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2c4b44-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2c4b44-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

replicaset-controller

payload-processing-external-model-7d7446f96

SuccessfulCreate

Created pod: payload-processing-external-model-7d7446f96-dg6pw

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7d7446f96 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7d7446f96

FailedCreate

Error creating: pods "payload-processing-external-model-7d7446f96-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

multus

payload-processing-external-model-7d7446f96-dg6pw

AddedInterface

Add eth0 [10.134.0.231/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7d7446f96-dg6pw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7d7446f96-dg6pw

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7d7446f96-dg6pw

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7d7446f96-dg6pw

Killing

Stopping container payload-processing
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sc85c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-sc85c

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sc85c

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sc85c

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-sc85c

AddedInterface

Add eth0 [10.133.0.234/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-84d4d45d7c from 1 to 2

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-84d4d45d7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sc85c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sc85c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-574c95cfc5 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-574c95cfc5

FailedCreate

Error creating: pods "payload-processing-external-model-574c95cfc5-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-574c95cfc5

SuccessfulCreate

Created pod: payload-processing-external-model-574c95cfc5-p2vlp

models-as-a-service

kubelet

payload-processing-external-model-574c95cfc5-p2vlp

Created

Container created

models-as-a-service

multus

payload-processing-external-model-574c95cfc5-p2vlp

AddedInterface

Add eth0 [10.134.0.237/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-574c95cfc5-p2vlp

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-574c95cfc5-p2vlp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

kubelet

payload-processing-external-model-574c95cfc5-p2vlp

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-a-3d5da6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-3d5da6

openshift-ingress

deployment-controller

e2e-inf-a-3d5da6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-3d5da6-openshift-default-df85545b9 from 0 to 1

openshift-ingress

multus

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-96b798988 from 0 to 1
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-96b798988

FailedCreate

Error creating: pods "payload-processing-external-model-96b798988-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-96b798988

SuccessfulCreate

Created pod: payload-processing-external-model-96b798988-vwbd2

openshift-ingress

replicaset-controller

e2e-inf-a-3d5da6-openshift-default-df85545b9

SuccessfulCreate

Created pod: e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

models-as-a-service

kubelet

payload-processing-external-model-96b798988-vwbd2

Started

Container started

models-as-a-service

multus

payload-processing-external-model-96b798988-vwbd2

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-96b798988-vwbd2

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-96b798988-vwbd2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-3d5da6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-3d5da6-74469dc9d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3d5da6: serviceaccount "payload-processing-e2e-inf-a-3d5da6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3d5da6-74469dc9d6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-3d5da6-74469dc9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3d5da6: serviceaccount "payload-processing-e2e-inf-a-3d5da6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3d5da6-74469dc9d6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-3d5da6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j

AddedInterface

Add eth0 [10.134.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ssskh

ProbeError

Readiness probe error: Get "http://10.133.0.225:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ssskh

Unhealthy

Readiness probe failed: Get "http://10.133.0.225:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

Unhealthy

Readiness probe failed: Get "http://10.134.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

ProbeError

Readiness probe error: Get "http://10.134.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

Unhealthy

Startup probe failed: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

ProbeError

Startup probe error: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2943ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2943ff

openshift-ingress

replicaset-controller

e2e-inf-a-2943ff-openshift-default-6466bddbf9

SuccessfulCreate

Created pod: e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

openshift-ingress

deployment-controller

e2e-inf-a-2943ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2943ff-openshift-default-6466bddbf9 from 0 to 1

openshift-ingress

multus

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7

SuccessfulCreate

Created pod: e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2wbd7

Unhealthy

Readiness probe failed: Get "http://10.132.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2wbd7

ProbeError

Readiness probe error: Get "http://10.132.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d97e4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d97e4c

openshift-ingress

deployment-controller

e2e-inf-b-d97e4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-jhqft

ProbeError

Readiness probe error: Get "http://10.133.0.226:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-jhqft

Unhealthy

Readiness probe failed: Get "http://10.133.0.226:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj

AddedInterface

Add eth0 [10.133.0.242/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2943ff: serviceaccount "payload-processing-e2e-inf-a-2943ff" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2943ff-79578bc87b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2943ff-79578bc87b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2943ff-79578bc87b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2943ff: serviceaccount "payload-processing-e2e-inf-a-2943ff" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2943ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2943ff-79578bc87b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2943ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d97e4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d97e4c-7767d8db7d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d97e4c-7767d8db7d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d97e4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d97e4c-7767d8db7d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d97e4c-7767d8db7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d97e4c: serviceaccount "payload-processing-e2e-inf-b-d97e4c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d97e4c: serviceaccount "payload-processing-e2e-inf-b-d97e4c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-96b798988-vwbd2

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-1fddb7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1fddb7-openshift-default-85fb47fcf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1fddb7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1fddb7

openshift-ingress

replicaset-controller

e2e-inf-a-1fddb7-openshift-default-85fb47fcf

SuccessfulCreate

Created pod: e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

openshift-ingress

multus

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

AddedInterface

Add eth0 [10.134.0.246/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1fddb7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1fddb7-77f8d94d4d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1fddb7-77f8d94d4d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1fddb7: serviceaccount "payload-processing-e2e-inf-a-1fddb7" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1fddb7: serviceaccount "payload-processing-e2e-inf-a-1fddb7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1fddb7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1fddb7-77f8d94d4d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-vxwlv

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-vxwlv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-vxwlv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-vxwlv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-vxwlv

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3d5da6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3d5da6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-a-db01c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-db01c4

openshift-ingress

deployment-controller

e2e-inf-a-db01c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-db01c4-openshift-default-779c66d87 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-db01c4-openshift-default-779c66d87

SuccessfulCreate

Created pod: e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

openshift-ingress

multus

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

AddedInterface

Add eth0 [10.133.0.246/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-db01c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-db01c4-5bd4b7f956 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-db01c4: serviceaccount "payload-processing-e2e-inf-a-db01c4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-db01c4-5bd4b7f956

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-db01c4-5bd4b7f956-7nkt6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-db01c4-5bd4b7f956

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-db01c4-5bd4b7f956-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-db01c4: serviceaccount "payload-processing-e2e-inf-a-db01c4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-db01c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-db01c4-5bd4b7f956-7nkt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-db01c4-5bd4b7f956-7nkt6

AddedInterface

Add eth0 [10.134.0.249/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p

AddedInterface

Add eth0 [10.134.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-db01c4-5bd4b7f956-7nkt6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-db01c4-5bd4b7f956-7nkt6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj

Unhealthy

Startup probe failed: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj

ProbeError

Startup probe error: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d97e4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d97e4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-inf-b-4593af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4593af-openshift-default-7f586bb5b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-4593af-openshift-default-7f586bb5b5

SuccessfulCreate

Created pod: e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

openshift-ingress

gateway_labeler_controller

e2e-inf-b-4593af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-4593af

openshift-ingress

multus

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

AddedInterface

Add eth0 [10.133.0.247/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-4593af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-4593af-79c769d8bc from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4593af: serviceaccount "payload-processing-e2e-inf-b-4593af" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4593af-6c44f48d6b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4593af-6c44f48d6b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-4593af-6c44f48d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4593af: serviceaccount "payload-processing-e2e-inf-b-4593af" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-4593af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-4593af-6c44f48d6b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2943ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp

AddedInterface

Add eth0 [10.134.0.252/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2943ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-4nhst

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d97e4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d97e4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

Unhealthy

Startup probe failed: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

ProbeError

Startup probe error: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 4 to 3

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c75203

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c75203

openshift-ingress

replicaset-controller

e2e-inf-b-c75203-openshift-default-5db7f76f89

SuccessfulCreate

Created pod: e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-inf-b-c75203-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c75203-openshift-default-5db7f76f89 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-5tfx7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

Unhealthy

Readiness probe failed: Get "http://10.133.0.246:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

ProbeError

Readiness probe error: Get "http://10.133.0.246:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c75203

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c75203-8485df74f5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c75203-7bcc988958

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c75203-7bcc988958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c75203: serviceaccount "payload-processing-e2e-inf-b-c75203" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c75203-8485df74f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c75203-8485df74f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c75203-8485df74f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c75203: serviceaccount "payload-processing-e2e-inf-b-c75203" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c75203

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c75203-7bcc988958 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c75203-7bcc988958

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw

AddedInterface

Add eth0 [10.134.0.253/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1fddb7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1fddb7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

Unhealthy

Startup probe failed: Get "http://10.133.0.246:15021/healthz/ready": dial tcp 10.133.0.246:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

ProbeError

Startup probe error: Get "http://10.134.0.246:15021/healthz/ready": dial tcp 10.134.0.246:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

ProbeError

Startup probe error: Get "http://10.133.0.246:15021/healthz/ready": dial tcp 10.133.0.246:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

Unhealthy

Startup probe failed: Get "http://10.134.0.246:15021/healthz/ready": dial tcp 10.134.0.246:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-db01c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-db01c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-inf-b-d207e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d207e8-openshift-default-55685dccbf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d207e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d207e8

openshift-ingress

replicaset-controller

e2e-inf-b-d207e8-openshift-default-55685dccbf

SuccessfulCreate

Created pod: e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2943ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2943ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb

AddedInterface

Add eth0 [10.133.0.253/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d207e8-597bf6d8c4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d207e8-597bf6d8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d207e8: serviceaccount "payload-processing-e2e-inf-b-d207e8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d207e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d207e8-597bf6d8c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d207e8-597bf6d8c4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d207e8-597bf6d8c4-trvfs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d207e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d207e8: serviceaccount "payload-processing-e2e-inf-b-d207e8" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv

AddedInterface

Add eth0 [10.134.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-db01c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-db01c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d207e8-597bf6d8c4-trvfs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-d207e8-597bf6d8c4-trvfs

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d207e8-597bf6d8c4-trvfs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d207e8-597bf6d8c4-trvfs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-a-52d131-openshift-default-67cf47669f

SuccessfulCreate

Created pod: e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

openshift-ingress

deployment-controller

e2e-inf-a-52d131-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-52d131-openshift-default-67cf47669f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-52d131

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-52d131

openshift-ingress

multus

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

AddedInterface

Add eth0 [10.133.0.255/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1fddb7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1fddb7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-52d131

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-52d131-64955cf7b8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-52d131: serviceaccount "payload-processing-e2e-inf-a-52d131" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-52d131

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-52d131-64955cf7b8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-52d131-64955cf7b8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-52d131-64955cf7b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-52d131: serviceaccount "payload-processing-e2e-inf-a-52d131" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n

AddedInterface

Add eth0 [10.134.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

Unhealthy

Readiness probe failed: Get "http://10.133.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

ProbeError

Readiness probe error: Get "http://10.133.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

ProbeError

Startup probe error: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

Unhealthy

Startup probe failed: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4593af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4593af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c75203-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c75203-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

ProbeError

Startup probe error: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

Unhealthy

Startup probe failed: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d207e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d207e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb

Unhealthy

Startup probe failed: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb

ProbeError

Startup probe error: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4593af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4593af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c75203-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c75203-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d207e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d207e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

Unhealthy

Readiness probe failed: Get "http://10.133.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

ProbeError

Readiness probe error: Get "http://10.133.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4593af-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-4593af-openshift-default-7f586bb5b5

SuccessfulCreate

Created pod: e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

openshift-ingress

deployment-controller

e2e-inf-b-4593af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4593af-openshift-default-7f586bb5b5 from 1 to 2

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-b-07fb25

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-07fb25

openshift-ingress

replicaset-controller

e2e-inf-b-07fb25-openshift-default-7d85d646c7

SuccessfulCreate

Created pod: e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

openshift-ingress

deployment-controller

e2e-inf-b-07fb25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-07fb25-openshift-default-7d85d646c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-3d5da6-openshift-default-df85545b9

SuccessfulCreate

Created pod: e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3d5da6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

ProbeError

Startup probe error: Get "http://10.133.0.255:15021/healthz/ready": dial tcp 10.133.0.255:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-3d5da6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-3d5da6-openshift-default-df85545b9 from 1 to 2
(x6)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

Unhealthy

Startup probe failed: Get "http://10.133.0.255:15021/healthz/ready": dial tcp 10.133.0.255:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

AddedInterface

Add eth0 [10.133.1.27/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-52d131-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-52d131-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

Unhealthy

Startup probe failed: Get "http://10.132.0.244:15021/healthz/ready": dial tcp 10.132.0.244:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

ProbeError

Startup probe error: Get "http://10.132.0.244:15021/healthz/ready": dial tcp 10.132.0.244:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-1fddb7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1fddb7-openshift-default-85fb47fcf from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-a-1fddb7-openshift-default-85fb47fcf

SuccessfulCreate

Created pod: e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1fddb7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

AddedInterface

Add eth0 [10.132.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-07fb25-5c59fb4c8b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-07fb25: serviceaccount "payload-processing-e2e-inf-b-07fb25" not found
(x6)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

ProbeError

Startup probe error: Get "http://10.133.1.27:15021/healthz/ready": dial tcp 10.133.1.27:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

Unhealthy

Startup probe failed: Get "http://10.133.1.27:15021/healthz/ready": dial tcp 10.133.1.27:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-07fb25

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-07fb25-5c59fb4c8b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-07fb25: serviceaccount "payload-processing-e2e-inf-b-07fb25" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-07fb25-5c59fb4c8b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-rcfwp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-07fb25

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-07fb25-654579f6bc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt

AddedInterface

Add eth0 [10.134.1.11/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-rcfwp

AddedInterface

Add eth0 [10.134.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-rcfwp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-rcfwp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-rcfwp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

Unhealthy

Startup probe failed: Get "http://10.132.0.245:15021/healthz/ready": dial tcp 10.132.0.245:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

ProbeError

Startup probe error: Get "http://10.132.0.245:15021/healthz/ready": dial tcp 10.132.0.245:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-52d131-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-52d131-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sc85c

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-sc85c
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-4fmkp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-594253-openshift-default-fc44dff6c

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-g7dwn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-594253-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-594253-openshift-default-fc44dff6c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-594253-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-84d4d45d7c from 2 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-84d4d45d7c

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-84d4d45d7cmchj4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

Unhealthy

Readiness probe failed: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-dqlkc

ProbeError

Readiness probe error: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-h9h8g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75d7c785f from 10 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-fpsp7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-ssskh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ssskh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-57s4v

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-jhqft

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-jhqft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-fpsp7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-57s4v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-58fad4-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-58fad4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-58fad4-openshift-default-7d558dc9c7 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7

SuccessfulDelete

Deleted pod: e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-888fl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

ProbeError

Startup probe error: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

Unhealthy

Startup probe failed: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f

SuccessfulDelete

Deleted pod: e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

openshift-ingress

deployment-controller

e2e-extmod-a-6b8bfa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-6b8bfa-openshift-default-7fc555776f from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6b8bfa-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-qsmmr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-07fb25-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-07fb25-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-07fb25-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-07fb25-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d5da6-697744bdcf-cvtxt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2h6s4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d5da6-74469dc9d6-98l6j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-3d5da6-openshift-default-df85545b9-2b6l5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-inf-a-52d131-openshift-default-67cf47669f

SuccessfulCreate

Created pod: e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

openshift-ingress

deployment-controller

e2e-inf-a-52d131-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-52d131-openshift-default-67cf47669f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-52d131-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

AddedInterface

Add eth0 [10.134.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

Unhealthy

Startup probe failed: Get "http://10.134.1.13:15021/healthz/ready": dial tcp 10.134.1.13:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

ProbeError

Startup probe error: Get "http://10.134.1.13:15021/healthz/ready": dial tcp 10.134.1.13:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d97e4c-7767d8db7d-wtkk2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d97e4c-6bc9cb45bc-5rk5d

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.245:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-d97e4c-openshift-default-7d7b8c58c7-mwggj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-2943ff-openshift-default-6466bddbf9-c8999

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2943ff-78c97d98ff-kg26t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2943ff-79578bc87b-nnr4x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4593af-6c44f48d6b-5rkrp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4593af-79c769d8bc-vmp5j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2wbd7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-rgk4t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75d7c785f from 6 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-2wbd7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-rgk4t

openshift-ingress

deployment-controller

e2e-worker-w4-b93d51-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-b93d51-openshift-default-7f57fdf98f from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b93d51-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f

SuccessfulDelete

Deleted pod: e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc

SuccessfulDelete

Deleted pod: e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-mpz2x

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9dfb3c-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-9dfb3c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc from 2 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-db01c4-5bd4b7f956-7nkt6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-mcc87

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1fddb7-77f8d94d4d-vxwlv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-bwczm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-m9q2m

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-2qvfs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2qvfs

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2qvfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-m9q2m

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-bwczm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-bwczm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-bwczm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-bwczm

AddedInterface

Add eth0 [10.133.1.38/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-m9q2m

AddedInterface

Add eth0 [10.133.1.40/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-2qvfs

AddedInterface

Add eth0 [10.133.1.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-9stc4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-9stc4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-m9q2m

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2qvfs

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-9stc4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-m9q2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-9stc4

AddedInterface

Add eth0 [10.134.1.14/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-m9q2m

ProbeError

Startup probe error: Get "http://10.133.1.40:15021/healthz/ready": dial tcp 10.133.1.40:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-bwczm

Unhealthy

Startup probe failed: Get "http://10.133.1.38:15021/healthz/ready": dial tcp 10.133.1.38:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-bwczm

ProbeError

Startup probe error: Get "http://10.133.1.38:15021/healthz/ready": dial tcp 10.133.1.38:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-9stc4

Unhealthy

Startup probe failed: Get "http://10.134.1.14:15021/healthz/ready": dial tcp 10.134.1.14:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2qvfs

Unhealthy

Startup probe failed: Get "http://10.133.1.39:15021/healthz/ready": dial tcp 10.133.1.39:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2qvfs

ProbeError

Startup probe error: Get "http://10.133.1.39:15021/healthz/ready": dial tcp 10.133.1.39:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-9stc4

ProbeError

Startup probe error: Get "http://10.134.1.14:15021/healthz/ready": dial tcp 10.134.1.14:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-m9q2m

Unhealthy

Startup probe failed: Get "http://10.133.1.40:15021/healthz/ready": dial tcp 10.133.1.40:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-m9q2m

Unhealthy

Startup probe failed: Get "http://10.133.1.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-bwczm

ProbeError

Startup probe error: Get "http://10.133.1.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-m9q2m

ProbeError

Startup probe error: Get "http://10.133.1.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-bwczm

Unhealthy

Startup probe failed: Get "http://10.133.1.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2qvfs

ProbeError

Startup probe error: Get "http://10.133.1.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2qvfs

Unhealthy

Startup probe failed: Get "http://10.133.1.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1fddb7-df6d869cf-dr8jt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-db01c4-f9bd75d8c-k2c4p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-mzxsn

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-5htrm

AddedInterface

Add eth0 [10.132.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-mzxsn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-5htrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-5htrm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-5htrm

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-mzxsn

AddedInterface

Add eth0 [10.133.1.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-mzxsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-mcvhf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-4593af-openshift-default-7f586bb5b5-4jw7m

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-5htrm

Unhealthy

Startup probe failed: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-5htrm

ProbeError

Startup probe error: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-mzxsn

ProbeError

Startup probe error: Get "http://10.133.1.41:15021/healthz/ready": dial tcp 10.133.1.41:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-mzxsn

Unhealthy

Startup probe failed: Get "http://10.133.1.41:15021/healthz/ready": dial tcp 10.133.1.41:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-hfz6l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-1fddb7-openshift-default-85fb47fcf-7d6z7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-db01c4-openshift-default-779c66d87-jrxqq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c75203-7bcc988958-8z9nw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c75203-8485df74f5-f4jzf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d207e8-597bf6d8c4-trvfs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d207e8-5f6bf985f5-k6lcv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-c75203-openshift-default-5db7f76f89-8mxc2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-d207e8-openshift-default-55685dccbf-v5rsb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-edae4317

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-edae4317

openshift-ingress

replicaset-controller

e2e-mt-edae4317-openshift-default-598d57ccbf

SuccessfulCreate

Created pod: e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

openshift-ingress

deployment-controller

e2e-mt-edae4317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-edae4317-openshift-default-598d57ccbf from 0 to 1

openshift-ingress

multus

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

AddedInterface

Add eth0 [10.133.1.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-edae4317-8477bbf575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-edae4317-8477bbf575-tjdfg

openshift-ingress

multus

payload-pre-processing-e2e-mt-edae4317-8477bbf575-tjdfg

AddedInterface

Add eth0 [10.134.1.15/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-edae4317

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-edae4317-69d497b588 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-edae4317-69d497b588

SuccessfulCreate

Created pod: payload-processing-e2e-mt-edae4317-69d497b588-dhfts

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-edae4317

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-edae4317-8477bbf575 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-edae4317-8477bbf575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-edae4317-8477bbf575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-edae4317: serviceaccount "payload-processing-e2e-mt-edae4317" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-edae4317-69d497b588

FailedCreate

Error creating: pods "payload-processing-e2e-mt-edae4317-69d497b588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-edae4317: serviceaccount "payload-processing-e2e-mt-edae4317" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-edae4317-69d497b588-dhfts

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-edae4317-8477bbf575-tjdfg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-edae4317-69d497b588-dhfts

AddedInterface

Add eth0 [10.134.1.16/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-edae4317-8477bbf575-tjdfg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-edae4317-69d497b588-dhfts

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-edae4317-69d497b588-dhfts

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-edae4317-8477bbf575-tjdfg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-edae4317-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-edae4317-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pc5cf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52d131-58d9cf5ccf-ngs9t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52d131-64955cf7b8-5qx6n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-52d131-openshift-default-67cf47669f-pvz6j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-07fb25-5c59fb4c8b-rcfwp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-c40a89-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-c40a89-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7

SuccessfulDelete

Deleted pod: e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-2s6zh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-07fb25-654579f6bc-gj6qt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

Unhealthy

Readiness probe failed: Get "http://10.133.1.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

ProbeError

Readiness probe error: Get "http://10.133.1.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

ProbeError

Startup probe error: Get "http://10.133.1.44:15021/healthz/ready": dial tcp 10.133.1.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

Unhealthy

Startup probe failed: Get "http://10.133.1.44:15021/healthz/ready": dial tcp 10.133.1.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-07fb25-openshift-default-7d85d646c7-882rx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-58fad4-5868577ff9-wkf64

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-edae4317-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-58fad4-75547c5dfb-kp4hw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-edae4317-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-58fad4-openshift-default-7d558dc9c7-6zz58

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-93ec46-openshift-default-8d6db8b57-nhh7h

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-719029-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-719029-openshift-default-75b56556b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

openshift-ingress

deployment-controller

e2e-worker-w2-719029-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-719029-openshift-default-75b56556b9 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c

SuccessfulDelete

Deleted pod: e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-78d5ff-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-78d5ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-rjn2d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-w424r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93ec46-7bb6f559fd-z2ncv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93ec46-6d87dc7b8c-p7gfs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulDelete

Deleted pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-qw6sn

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4153e5-b59c4f658-tgf8r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4153e5-547d45cf79-fhshn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-4153e5-openshift-default-d76468489-mtrkn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-17e747-6c68bf6668-ktzxk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-17e747-54ffc45d87-zpls8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0ce950-84cb98fcf5-gfpbs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0ce950-5db457fb88-q2nzh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-0ce950-openshift-default-88864987c-5sxfw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-mt-edae4317-69d497b588-dhfts

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-edae4317-8477bbf575-tjdfg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w4-17e747-openshift-default-6bfc467795-xcsj2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-edae4317-openshift-default-598d57ccbf-5brqx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-000edd-d5b7c669f-m9hfq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-000edd-64d8869796-mcg8l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-000edd-openshift-default-6dfb97cbcc-mvdfb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-3a00b8-7449c77959-cg5r9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-3a00b8-7f465f49db-8tg6k

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b93d51-66c97d5bb6-2gpw9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b93d51-6f4bdfb747-gr4c8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b93d51-openshift-default-7f57fdf98f-xw5ld

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-3a00b8-openshift-default-6b6cb8c5cc-xk488

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a0684f-5cc6fbf578-pj79b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a0684f-84d555f9d7-25wf9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-a0684f-openshift-default-66d4745cfc-zq5d9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-f6f4f0-7447ff75b-wxn5z

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-f6f4f0-6bfcfffbc9-b6cdz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-f6f4f0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-f6f4f0-openshift-default-78469759d7

SuccessfulCreate

Created pod: e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-f6f4f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-f6f4f0-openshift-default-78469759d7 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

AddedInterface

Add eth0 [10.134.1.21/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

ProbeError

Startup probe error: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

Unhealthy

Startup probe failed: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

Unhealthy

Startup probe failed: Get "http://10.134.1.21:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

ProbeError

Startup probe error: Get "http://10.134.1.21:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-tkqwj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-f6f4f0-openshift-default-78469759d7-7cvxx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr74l

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-xr74l

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr74l

ProbeError

Readiness probe error: Get "http://10.132.0.102:8080/ready": dial tcp 10.132.0.102:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xr74l

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:8080/ready": dial tcp 10.132.0.102:8080: connect: connection refused

opendatahub

multus

test-curl-11184-01ba9d

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11184-01ba9d

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-11184-01ba9d

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.082s (2.082s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11184-01ba9d

Created

Container created

opendatahub

kubelet

test-curl-11184-01ba9d

Started

Container started

opendatahub

kubelet

test-curl-11184-102e4f

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11184-102e4f

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11184-01ba9d

Killing

Stopping container test-curl-11184-01ba9d

opendatahub

kubelet

test-curl-11184-102e4f

Created

Container created

opendatahub

kubelet

test-curl-11184-102e4f

Started

Container started

opendatahub

kubelet

test-curl-11184-102e4f

Killing

Stopping container test-curl-11184-102e4f

openshift-ingress

deployment-controller

e2e-shared-a-w2-584ec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-584ec5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff

SuccessfulCreate

Created pod: e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

ProbeError

Startup probe error: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

Unhealthy

Startup probe failed: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6b8bfa-6cbb86d6fd-mh9c9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-95f40f-openshift-default-c68d485cc-z2ml7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-mzxsn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-2qvfs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-mzxsn
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75d7c785f from 10 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-9stc4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75d7c785f-m9q2m

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-m9q2m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-bwczm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-95f40f-5f5d6f56c-sjvh7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-95f40f-5ff9b95c8d-mjtg2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6b8bfa-6d5656f495-5sr8n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2c4b44-f4ddfc467-4q2rj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2c4b44-76d85598d-jznf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-6b8bfa-openshift-default-7fc555776f-p8scj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-2c4b44-openshift-default-79c69c5d7c-sm2kg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a0fc73-5b8bddf64d-v62bk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a0fc73-7b84b6d8ff-ccvzf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-9dfb3c-openshift-default-89b9d99fc-nhlpp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-a0fc73-openshift-default-c964896bf-cx4rg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9dfb3c-7f56b7789f-sxmvj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9dfb3c-684d7bc7cb-pl462

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-h8str

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-584ec5-openshift-default-df7b9d5ff-rhvck

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-584ec5-5bdd9dcf6d-bjvv5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-584ec5-845b8d8d95-lr8hz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-0fdc4e-openshift-default-677dc68fd9-g7rlh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-24fb97-openshift-default-7b8d9f6cdf-mljv9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-01a9cd-openshift-default-8468779c9c-n7zbd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0fdc4e-dbc9d6c8c-7fbgz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0fdc4e-6fb5b8d96b-lvw2k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-24fb97-7b6cbd5699-nc5tp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-24fb97-f5bb9c87d-xwxd9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-2819d2-openshift-default-5b6cdbf47-k9qvg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01a9cd-5c86c7f8dc-42ggj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01a9cd-86cc4f65f4-m8kng

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-719029-66c86885dc-klbw6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-719029-68f6795878-p8vdz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-2819d2-6f8d85c6cb-bhhlm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-594253-openshift-default-fc44dff6c-zftfz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-2819d2-6f9f68cc79-9fxrc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-9a1cd0-openshift-default-d569ddc65-qpvvl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-594253-67c8c9db64-58zp9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-719029-openshift-default-75b56556b9-qvppw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-594253-9c78f8587-4hdwj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-9a1cd0-76568b9b9d-mg2lr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-9a1cd0-686646dd55-vfsfw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75d7c785f from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-5htrm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-78d5ff-7c6d864484-n6nd6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-78d5ff-776dc9868c-wpbv6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-78d5ff-openshift-default-5c9bf5c56c-qrlzx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c40a89-5bcc67755f-wsrrl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c40a89-6759b44d8-tz9b6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-c40a89-openshift-default-6dfbd8dcb7-s99t4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ait-a0944980-openshift-default-d4b4774f5

SuccessfulCreate

Created pod: e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

openshift-ingress

deployment-controller

e2e-ait-a0944980-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a0944980-openshift-default-d4b4774f5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-a0944980

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a0944980

openshift-ingress

multus

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

AddedInterface

Add eth0 [10.132.1.5/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a0944980-7f77d8bd9b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a0944980-7f77d8bd9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a0944980: serviceaccount "payload-processing-e2e-ait-a0944980" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a0944980: serviceaccount "payload-processing-e2e-ait-a0944980" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-llfjt

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a0944980

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a0944980-7f77d8bd9b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a0944980

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-a0944980-7f77d8bd9b-t6tkk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-llfjt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-a0944980-7f77d8bd9b-t6tkk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-a0944980-7f77d8bd9b-t6tkk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-llfjt

AddedInterface

Add eth0 [10.132.1.6/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-llfjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a0944980-7f77d8bd9b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a0944980-7f77d8bd9b-t6tkk

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-llfjt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-a0944980-7f77d8bd9b-t6tkk

AddedInterface

Add eth0 [10.134.1.26/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

Started

Container started

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

ProbeError

Readiness probe error: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

Unhealthy

Readiness probe failed: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

ProbeError

Startup probe error: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

Unhealthy

Startup probe failed: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a0944980-67bd8c5fc9-llfjt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a0944980-7f77d8bd9b-t6tkk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a0944980-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a0944980-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

opendatahub

kubelet

maas-controller-75b4575b56-7wgng

Killing

Stopping container manager

openshift-ingress

kubelet

e2e-ait-a0944980-openshift-default-d4b4774f5-vvnrf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

replicaset-controller

maas-controller-75b4575b56

SuccessfulDelete

Deleted pod: maas-controller-75b4575b56-7wgng

opendatahub

replicaset-controller

maas-controller-75b4575b56

SuccessfulCreate

Created pod: maas-controller-75b4575b56-4865l

opendatahub

multus

maas-controller-75b4575b56-4865l

AddedInterface

Add eth0 [10.134.1.27/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-75b4575b56-4865l

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8d6921db01c0df05e20382b0469d2152d89933a9ec89b3b45026b72cdab0dbf2" in 404ms (404ms including waiting). Image size: 200057367 bytes.

opendatahub

kubelet

maas-controller-75b4575b56-4865l

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8d6921db01c0df05e20382b0469d2152d89933a9ec89b3b45026b72cdab0dbf2"

opendatahub

kubelet

maas-controller-75b4575b56-4865l

Started

Container started

opendatahub

kubelet

maas-controller-75b4575b56-4865l

Created

Container created

opendatahub

maas-controller-75b4575b56-4865l_7f464521-e2d2-4258-a77a-6d2a486047ad

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-75b4575b56-4865l_7f464521-e2d2-4258-a77a-6d2a486047ad became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-lxtlt

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-b95w4

AddedInterface

Add eth0 [10.133.1.76/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-lxtlt

AddedInterface

Add eth0 [10.134.1.28/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zvgvw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-b95w4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-b95w4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-lxtlt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-b95w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zvgvw

Created

Container created
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75d7c785f from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75d7c785f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75d7c785f-28ssd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zvgvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-zvgvw

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-lxtlt

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-28ssd

AddedInterface

Add eth0 [10.133.1.75/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-28ssd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-28ssd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-28ssd

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-lxtlt

Unhealthy

Startup probe failed: Get "http://10.134.1.28:15021/healthz/ready": dial tcp 10.134.1.28:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-lxtlt

ProbeError

Startup probe error: Get "http://10.134.1.28:15021/healthz/ready": dial tcp 10.134.1.28:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-28ssd

ProbeError

Startup probe error: Get "http://10.133.1.75:15021/healthz/ready": dial tcp 10.133.1.75:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zvgvw

ProbeError

Startup probe error: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zvgvw

Unhealthy

Startup probe failed: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-b95w4

Unhealthy

Startup probe failed: Get "http://10.133.1.76:15021/healthz/ready": dial tcp 10.133.1.76:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-b95w4

ProbeError

Startup probe error: Get "http://10.133.1.76:15021/healthz/ready": dial tcp 10.133.1.76:15021: connect: connection refused body:
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-75b4575b56 from 1 to 0
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-28ssd

Unhealthy

Startup probe failed: Get "http://10.133.1.75:15021/healthz/ready": dial tcp 10.133.1.75:15021: connect: connection refused

opendatahub

replicaset-controller

maas-controller-75b4575b56

SuccessfulDelete

Deleted pod: maas-controller-75b4575b56-4865l

opendatahub

kubelet

maas-controller-75b4575b56-4865l

Killing

Stopping container manager
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-75b4575b56 from 0 to 1

opendatahub

replicaset-controller

maas-controller-75b4575b56

SuccessfulCreate

Created pod: maas-controller-75b4575b56-vfzpw

opendatahub

kubelet

maas-controller-75b4575b56-vfzpw

Started

Container started

opendatahub

kubelet

maas-controller-75b4575b56-vfzpw

Created

Container created

opendatahub

kubelet

maas-controller-75b4575b56-vfzpw

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8d6921db01c0df05e20382b0469d2152d89933a9ec89b3b45026b72cdab0dbf2" in 329ms (329ms including waiting). Image size: 200057367 bytes.

opendatahub

multus

maas-controller-75b4575b56-vfzpw

AddedInterface

Add eth0 [10.134.1.29/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-75b4575b56-vfzpw

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8d6921db01c0df05e20382b0469d2152d89933a9ec89b3b45026b72cdab0dbf2"
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75d7c785f from 8 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-4spcb

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

multus

maas-default-gateway-openshift-default-75d7c785f-ppvtr

AddedInterface

Add eth0 [10.133.1.77/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ppvtr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ppvtr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-4spcb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ppvtr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-4spcb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-4spcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ppvtr

ProbeError

Startup probe error: Get "http://10.133.1.77:15021/healthz/ready": dial tcp 10.133.1.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ppvtr

Unhealthy

Startup probe failed: Get "http://10.133.1.77:15021/healthz/ready": dial tcp 10.133.1.77:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-4spcb

ProbeError

Startup probe error: Get "http://10.132.1.10:15021/healthz/ready": dial tcp 10.132.1.10:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-4spcb

Unhealthy

Startup probe failed: Get "http://10.132.1.10:15021/healthz/ready": dial tcp 10.132.1.10:15021: connect: connection refused

opendatahub

maas-controller-75b4575b56-vfzpw_2adee250-f9c3-486b-aed0-ff7df44a2951

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-75b4575b56-vfzpw_2adee250-f9c3-486b-aed0-ff7df44a2951 became leader

llm

deployment-controller

e2e-prio-pool-8b3c5a4d-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-8b3c5a4d-kserve-fd74466b5 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-8b3c5a4d-epp-auth-rb

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.Secret llm/e2e-prio-pool-8b3c5a4d-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.Deployment llm/e2e-prio-pool-8b3c5a4d-kserve-router-scheduler

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.RoleBinding llm/e2e-prio-pool-8b3c5a4d-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.Role llm/e2e-prio-pool-8b3c5a4d-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.Service llm/e2e-prio-pool-8b3c5a4d-epp-service

llm

replicaset-controller

e2e-prio-pool-8b3c5a4d-kserve-fd74466b5

SuccessfulCreate

Created pod: e2e-prio-pool-8b3c5a4d-kserve-fd74466b5-wjrgx

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.ServiceAccount llm/e2e-prio-pool-8b3c5a4d-epp-sa

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.Service llm/e2e-prio-pool-8b3c5a4d-kserve-workload-svc

llm

replicaset-controller

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44

SuccessfulCreate

Created pod: e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

Created v1.Deployment llm/e2e-prio-pool-8b3c5a4d-kserve

llm

deployment-controller

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44 from 0 to 1

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-fd74466b5-wjrgx

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

multus

e2e-prio-pool-8b3c5a4d-kserve-fd74466b5-wjrgx

AddedInterface

Add eth0 [10.132.1.15/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-fd74466b5-wjrgx

Created

Container created

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-fd74466b5-wjrgx

Started

Container started

llm

multus

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

AddedInterface

Add eth0 [10.134.1.30/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-8b3c5a4d-kserve-route
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-8b3c5a4d-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 1.624s (1.624s including waiting). Image size: 184206420 bytes.

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

Created

Container created

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Updated

Updated v1.Secret llm/e2e-prio-pool-8b3c5a4d-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-8b3c5a4d] is Ready

llm

LLMInferenceServiceController

e2e-prio-pool-8b3c5a4d

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-8b3c5a4d-epp-auth-rb

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-fd74466b5-wjrgx

Killing

Stopping container main

openshift-ingress

replicaset-controller

e2e-worker-single-main-88fa81-openshift-default-b74b6f697

SuccessfulCreate

Created pod: e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

openshift-ingress

deployment-controller

e2e-worker-single-main-88fa81-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-88fa81-openshift-default-b74b6f697 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-88fa81

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-88fa81

openshift-ingress

multus

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-88fa81

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-88fa81-697c96c4d4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-88fa81-697c96c4d4

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-88fa81-697c96c4d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-88fa81: serviceaccount "payload-processing-e2e-worker-single-main-88fa81" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-88fa81-697c96c4d4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-88fa81

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-88fa81-77b8959f99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-88fa81-77b8959f99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-88fa81-77b8959f99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-88fa81-77b8959f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-88fa81: serviceaccount "payload-processing-e2e-worker-single-main-88fa81" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj

AddedInterface

Add eth0 [10.132.1.20/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8

AddedInterface

Add eth0 [10.132.1.21/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

Unhealthy

Readiness probe failed: Get "http://10.132.1.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

ProbeError

Readiness probe error: Get "http://10.132.1.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

Unhealthy

Startup probe failed: Get "http://10.132.1.18:15021/healthz/ready": dial tcp 10.132.1.18:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

ProbeError

Startup probe error: Get "http://10.132.1.18:15021/healthz/ready": dial tcp 10.132.1.18:15021: connect: connection refused body:
(x5)

llm

kubelet

e2e-prio-pool-8b3c5a4d-kserve-router-scheduler-65c46dcd44-vrsq6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-88fa81-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-88fa81-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-88fa81-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-88fa81-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-88fa81-openshift-default-b74b6f697-48r2c

Killing

Stopping container istio-proxy

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Created

Created v1.Service llm/e2e-same-id-a-50b514ff-kserve-workload-svc

llm

multus

e2e-same-id-a-50b514ff-kserve-5cbd7cb68f-bkfsn

AddedInterface

Add eth0 [10.134.1.31/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-a-50b514ff-kserve-5cbd7cb68f-bkfsn

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-50b514ff-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Created

Created v1.Deployment llm/e2e-same-id-a-50b514ff-kserve

llm

kubelet

e2e-same-id-a-50b514ff-kserve-5cbd7cb68f-bkfsn

Created

Container created

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Created

Created v1.PodMonitor llm/e2e-same-id-a-50b514ff-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Created

Created v1.PodMonitor llm/e2e-same-id-a-50b514ff-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Created

Created v1.DestinationRule llm/e2e-same-id-a-50b514ff-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Created

Created v1.HTTPRoute llm/e2e-same-id-a-50b514ff-kserve-route

llm

kubelet

e2e-same-id-a-50b514ff-kserve-5cbd7cb68f-bkfsn

Started

Container started

llm

replicaset-controller

e2e-same-id-a-50b514ff-kserve-5cbd7cb68f

SuccessfulCreate

Created pod: e2e-same-id-a-50b514ff-kserve-5cbd7cb68f-bkfsn

llm

deployment-controller

e2e-same-id-a-50b514ff-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-50b514ff-kserve-5cbd7cb68f from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Created

Created v1.Secret llm/e2e-same-id-a-50b514ff-kserve-self-signed-certs
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-88fa81-77b89jt6pj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-88fa81-697c96c4d9bvd8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

Updated

Updated v1.Secret llm/e2e-same-id-a-50b514ff-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-50b514ff] is Ready

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Created

Created v1.Secret llm/e2e-same-id-b-50b514ff-kserve-self-signed-certs

llm

deployment-controller

e2e-same-id-b-50b514ff-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-50b514ff-kserve-8448dcb4f7 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Created

Created v1.Service llm/e2e-same-id-b-50b514ff-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Created

Created v1.PodMonitor llm/e2e-same-id-b-50b514ff-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Created

Created v1.PodMonitor llm/e2e-same-id-b-50b514ff-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Created

Created v1.DestinationRule llm/e2e-same-id-b-50b514ff-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Created

Created v1.HTTPRoute llm/e2e-same-id-b-50b514ff-kserve-route

llm

kubelet

e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-50b514ff-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Created

Created v1.Deployment llm/e2e-same-id-b-50b514ff-kserve

llm

kubelet

e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5

Created

Container created

llm

replicaset-controller

e2e-same-id-b-50b514ff-kserve-8448dcb4f7

SuccessfulCreate

Created pod: e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5

llm

multus

e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5

AddedInterface

Add eth0 [10.132.1.23/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

Updated

Updated v1.Secret llm/e2e-same-id-b-50b514ff-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-50b514ff] is Ready
(x4)

llm

LLMInferenceServiceController

e2e-same-id-a-50b514ff

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-50b514ff in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-50b514ff; safe to ignore if traffic splitting is planned
(x6)

llm

LLMInferenceServiceController

e2e-same-id-b-50b514ff

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-50b514ff in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-50b514ff; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-50b514ff-kserve-5cbd7cb68f-bkfsn

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-50b514ff-kserve-8448dcb4f7-zk4k5

Unhealthy

Readiness probe failed: Get "https://10.132.1.23:8000/ready": dial tcp 10.132.1.23:8000: connect: connection refused

openshift-ingress

multus

payload-pre-processing-8dd7b7cc5-ngv24

AddedInterface

Add eth0 [10.134.1.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-8dd7b7cc5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-8dd7b7cc5-ngv24

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-8dd7b7cc5-ngv24

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-8dd7b7cc5-ngv24

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-8dd7b7cc5

SuccessfulCreate

Created pod: payload-pre-processing-8dd7b7cc5-ngv24

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-xsvkx

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xsvkx

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

replicaset-controller

payload-processing-56f8ccc945

SuccessfulCreate

Created pod: payload-processing-56f8ccc945-54crd

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-56f8ccc945 from 0 to 1

openshift-ingress

kubelet

payload-processing-56f8ccc945-54crd

Started

Container started

openshift-ingress

kubelet

payload-processing-56f8ccc945-54crd

Created

Container created

openshift-ingress

kubelet

payload-processing-56f8ccc945-54crd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-56f8ccc945-54crd

AddedInterface

Add eth0 [10.132.1.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-qfc9q

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulDelete

Deleted pod: payload-processing-5f78687d5b-qfc9q

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-5f78687d5b from 1 to 0

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7bf6df7cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-75c985bd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-7bf6df7cf

SuccessfulCreate

Created pod: payload-pre-processing-7bf6df7cf-qcpgl

openshift-ingress

replicaset-controller

payload-processing-75c985bd9

SuccessfulCreate

Created pod: payload-processing-75c985bd9-6thmd

openshift-ingress

kubelet

payload-processing-75c985bd9-6thmd

Started

Container started

openshift-ingress

kubelet

payload-processing-75c985bd9-6thmd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-7bf6df7cf-qcpgl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7bf6df7cf-qcpgl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7bf6df7cf-qcpgl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-7bf6df7cf-qcpgl

AddedInterface

Add eth0 [10.132.1.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-75c985bd9-6thmd

AddedInterface

Add eth0 [10.134.1.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-75c985bd9-6thmd

Created

Container created

openshift-ingress

kubelet

payload-processing-56f8ccc945-54crd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-8dd7b7cc5-ngv24

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-56f8ccc945

SuccessfulDelete

Deleted pod: payload-processing-56f8ccc945-54crd

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-56f8ccc945 from 1 to 0

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-8dd7b7cc5 from 1 to 0

openshift-ingress

replicaset-controller

payload-pre-processing-8dd7b7cc5

SuccessfulDelete

Deleted pod: payload-pre-processing-8dd7b7cc5-ngv24

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-758758b45d from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-758758b45d

FailedCreate

Error creating: pods "payload-processing-external-model-758758b45d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

multus

payload-processing-external-model-758758b45d-pnxwc

AddedInterface

Add eth0 [10.134.1.34/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-pnxwc

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-pnxwc

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-pnxwc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-758758b45d

SuccessfulCreate

Created pod: payload-processing-external-model-758758b45d-pnxwc

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-pnxwc

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-447d90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-447d90

openshift-ingress

replicaset-controller

e2e-worker-single-main-447d90-openshift-default-6c9688cb89

SuccessfulCreate

Created pod: e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

openshift-ingress

deployment-controller

e2e-worker-single-main-447d90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-447d90-openshift-default-6c9688cb89 from 0 to 1

openshift-ingress

multus

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

AddedInterface

Add eth0 [10.132.1.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-447d90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-447d90-949865447 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-447d90-949865447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-447d90-949865447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-447d90: serviceaccount "payload-processing-e2e-worker-single-main-447d90" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-447d90-9f6c86d76

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-447d90-9f6c86d76

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-447d90-9f6c86d76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-447d90: serviceaccount "payload-processing-e2e-worker-single-main-447d90" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-447d90-949865447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-447d90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-447d90-9f6c86d76 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv

AddedInterface

Add eth0 [10.132.1.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh

AddedInterface

Add eth0 [10.134.1.36/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

Created

Container created

openshift-ingress

kubelet

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

Unhealthy

Readiness probe failed: Get "http://10.132.1.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

ProbeError

Readiness probe error: Get "http://10.132.1.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

ProbeError

Startup probe error: Get "http://10.132.1.43:15021/healthz/ready": dial tcp 10.132.1.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

Unhealthy

Startup probe failed: Get "http://10.132.1.43:15021/healthz/ready": dial tcp 10.132.1.43:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-447d90-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-447d90-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-447d90-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-447d90-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-447d90-openshift-default-6c9688cb89swbk8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-447d90-9f6c86d76tnrjv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-447d90-949866l2jh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-rjj9l

Killing

Stopping container manager

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-rjj9l

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-s228v
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-s228v

Created

Container created
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-s228v

Started

Container started
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-s228v

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-s228v

AddedInterface

Add eth0 [10.133.1.81/23] from ovn-kubernetes
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-s228v_0b7264a0-7675-4736-a759-e04a1a4e8549

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-s228v_0b7264a0-7675-4736-a759-e04a1a4e8549 became leader
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-lxtlt

Unhealthy

Readiness probe failed: Get "http://10.134.1.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ppvtr

Unhealthy

Readiness probe failed: Get "http://10.133.1.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-lxtlt

ProbeError

Readiness probe error: Get "http://10.134.1.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-ppvtr

ProbeError

Readiness probe error: Get "http://10.133.1.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-28ssd

ProbeError

Readiness probe error: Get "http://10.133.1.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-b95w4

ProbeError

Readiness probe error: Get "http://10.133.1.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-4spcb

Unhealthy

Readiness probe failed: Get "http://10.132.1.10:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zvgvw

Unhealthy

Readiness probe failed: Get "http://10.132.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-zvgvw

ProbeError

Readiness probe error: Get "http://10.132.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-b95w4

Unhealthy

Readiness probe failed: Get "http://10.133.1.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-28ssd

Unhealthy

Readiness probe failed: Get "http://10.133.1.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-4spcb

ProbeError

Readiness probe error: Get "http://10.132.1.10:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nzg5g

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75d7c785f-nzg5g

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)