Time Namespace Component RelatedObject Reason Message

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-xfldb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-xfldb to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz to ip-10-0-138-160.ec2.internal

ai-tenants

e2e-api-b-0c530e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-0c530e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-397bda

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-397bda: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-721c85

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-721c85: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-20a650

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-20a650: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-05bee8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-05bee8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-6378cc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-6378cc: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-c0d6e7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-c0d6e7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-c0e964

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-c0e964: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-ed8266

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-ed8266: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-483bea

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-483bea: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-503804

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-503804: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-91705f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-91705f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-b195d0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-b195d0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-fcf42a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-fcf42a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-134dad

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-134dad: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-449d83

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-449d83: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-5f1508

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-5f1508: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-7700a7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-7700a7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-9f158a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-9f158a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-26b72f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-26b72f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-82bec5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-82bec5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-e592d7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-e592d7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-f9cd17

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-f9cd17: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-fd27a9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-fd27a9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-3f5508

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-3f5508: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-6dcea5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-6dcea5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-baa474

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-baa474: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-bf4238

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-bf4238: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-f7a36d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-f7a36d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-6a777c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-6a777c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-763bde

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-763bde: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-b1a417

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-b1a417: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-ca7a81

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-ca7a81: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-dbabed

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-dbabed: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-1a0d3427

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-1a0d3427: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-b5496290

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-b5496290: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-153a44

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-153a44: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-58cdc8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-58cdc8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-71b161

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-71b161: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-86eaa9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-86eaa9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-05f827

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-05f827: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-2696d8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-2696d8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-448a3a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-448a3a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-eb9d23

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-eb9d23: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-e6b837

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-e6b837: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-fcd6a6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-fcd6a6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-e070ea

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-e070ea: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-4c2415

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-4c2415: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-247158

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-247158: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-66217b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-66217b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-495ebe

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-495ebe: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-bbce72

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-bbce72: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-single-main-042f4c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-single-main-042f4c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-single-main-6949ad

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-single-main-6949ad: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-36bbac

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-36bbac: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-6796b1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-6796b1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-5d74b9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-5d74b9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-b4708a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-b4708a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-a2f984

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-a2f984: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-wf5lc

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-wf5lc to ip-10-0-138-160.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-mvz4d

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-mvz4d to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-nv59r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-nv59r to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-xhf65

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-xhf65 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-wdjwj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-wdjwj to ip-10-0-138-160.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-bd9vx

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-bd9vx to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4 to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-s7svm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-s7svm to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf to ip-10-0-139-99.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-m6qxl

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-m6qxl to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-vqwgv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-vqwgv to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-f7rf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-f7rf9 to ip-10-0-138-160.ec2.internal

kuadrant-system

authorino-57f7f8659f-pnhp4

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-pnhp4 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-qtvjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-qtvjt to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-q4pvt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-q4pvt to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-snwbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-snwbg to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-qsmkf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-qsmkf to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-gkwvz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-gkwvz to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-7lvkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-7lvkw to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-vrrxq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-vrrxq to ip-10-0-138-177.ec2.internal

kuadrant-system

authorino-65f8dc9b64-t2xjq

Scheduled

Successfully assigned kuadrant-system/authorino-65f8dc9b64-t2xjq to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-vsv9v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-vsv9v to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-gn2cq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-gn2cq to ip-10-0-138-177.ec2.internal

ai-tenants

e2e-api-a-e124dc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-e124dc: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-ipp-b-dbabed-854d595775-9fmt4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dbabed-854d595775-9fmt4 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-v4c6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-v4c6p to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-566c3724-866768ccdc-j265f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-566c3724-866768ccdc-j265f to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx to ip-10-0-139-99.ec2.internal

kuadrant-system

authorino-6889cbd8c4-nvhp8

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-nvhp8 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f to ip-10-0-138-177.ec2.internal

kuadrant-system

authorino-6f6944bcdd-57jln

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-57jln to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-d6p8t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-d6p8t to ip-10-0-139-99.ec2.internal

kuadrant-system

authorino-757f4bf64c-szwjz

Scheduled

Successfully assigned kuadrant-system/authorino-757f4bf64c-szwjz to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-v55ff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-v55ff to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-zmcx8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-zmcx8 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6 to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn to ip-10-0-138-160.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-c4zkg

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-c4zkg to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-9nhwj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-9nhwj to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-721c85-76b87c7df5-kl8rr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-721c85-76b87c7df5-kl8rr to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-w4dgt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-w4dgt to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-sd87n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-sd87n to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-wdcgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-wdcgr to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-mg98p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-mg98p to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-bbdgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-bbdgh to ip-10-0-139-99.ec2.internal

kuadrant-system

authorino-webhooks

ClusterIPNotAllocated

Cluster IP [IPv4]: 172.31.138.25 is not allocated; repairing

openshift-ingress

payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-tssf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-tssf6 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-448a3a-559597875-cxb2w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-448a3a-559597875-cxb2w to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-2kfrx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-2kfrx to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl to ip-10-0-139-99.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-pg5vv

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-pg5vv to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29 to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0c530e-98c979bbc-hk7vz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0c530e-98c979bbc-hk7vz to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-mrvv4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-mrvv4 to ip-10-0-138-177.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-vmffb

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-vmffb to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e124dc-96dfb687-6k6rx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e124dc-96dfb687-6k6rx to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-eb861bd9-989d48df5-j2fzh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-eb861bd9-989d48df5-j2fzh to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5 to ip-10-0-138-177.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7nhv2

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7nhv2 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-de5733f9-744cdf6475-c6fkx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-de5733f9-744cdf6475-c6fkx to ip-10-0-138-177.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7pv2q

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7pv2q to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-5688bd49d7-w75hb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5688bd49d7-w75hb to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-l4r5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-l4r5r to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-77bf598fff-7f6b5

Scheduled

Successfully assigned openshift-ingress/payload-processing-77bf598fff-7f6b5 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a566022b-5cd659b5bb-7rzrg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a566022b-5cd659b5bb-7rzrg to ip-10-0-138-177.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-tcmbg

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tcmbg to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ad07bf73-574bf7494b-6dksz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ad07bf73-574bf7494b-6dksz to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ait-de5733f9-55fc6fc67d-fcfmt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-de5733f9-55fc6fc67d-fcfmt to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-ait-eb861bd9-5b6494876d-zwftz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-eb861bd9-5b6494876d-zwftz to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-2cpp4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-2cpp4 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e124dc-7c47449b48-f5r48

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e124dc-7c47449b48-f5r48 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a566022b-c898dff55-t8pdb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a566022b-c898dff55-t8pdb to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-v7lnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-v7lnv to ip-10-0-138-177.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-k9mm7

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-k9mm7 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-pre-processing-5c58448fd8-7pcq4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-5c58448fd8-7pcq4 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-pre-processing-58744ff6df-48bdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-58744ff6df-48bdt to ip-10-0-138-160.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-vg5td

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-vg5td to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0c530e-64d8846c56-w64nj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0c530e-64d8846c56-w64nj to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-397bda-65fb8d6656-ngr2l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-397bda-65fb8d6656-ngr2l to ip-10-0-138-160.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-7cc4b68895-sxj66

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-sxj66 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-autores-721c85-7fb8654d7b-tjrcq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-721c85-7fb8654d7b-tjrcq to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-derive-cb1a18be-dd97f446b-j2p8n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-cb1a18be-dd97f446b-j2p8n to ip-10-0-138-177.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-mjlc5

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-mjlc5 to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-20a650-7f7568947d-v6f87

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-20a650-7f7568947d-v6f87 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-4vrnx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-4vrnx to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-ed8266-859f7dcc46-khc55

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ed8266-859f7dcc46-khc55 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-9q274

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-9q274 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-449d83-6f7f8b8c6-h7dc5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-449d83-6f7f8b8c6-h7dc5 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-26b72f-8499db668d-zkxrm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-26b72f-8499db668d-zkxrm to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e592d7-846f4f9454-glsqh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e592d7-846f4f9454-glsqh to ip-10-0-139-99.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-df9pk

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-df9pk to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-bkggj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-bkggj to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3f5508-69d86d8b84-nvfm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3f5508-69d86d8b84-nvfm6 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-79nmt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-79nmt to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-cd55r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-cd55r to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-20a650-openshift-default-54678c495c-j52w6 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729 to ip-10-0-138-177.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-xxxsx

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-xxxsx to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

Scheduled

Successfully assigned openshift-ingress/e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-v4cbr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-v4cbr to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6 to ip-10-0-138-160.ec2.internal

ai-tenants

e2e-api-a-e3c43b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-e3c43b: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-ipp-a-baa474-66457b6895-g8dj9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-baa474-66457b6895-g8dj9 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-x8mpd to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-autores-721c85-openshift-default-7dfccc8995-fz988

Scheduled

Successfully assigned openshift-ingress/e2e-autores-721c85-openshift-default-7dfccc8995-fz988 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-x8gd4 to ip-10-0-138-160.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-l8nmh

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-l8nmh to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-wmnwp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-wmnwp to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

Scheduled

Successfully assigned openshift-ingress/e2e-autores-721c85-openshift-default-7dfccc8995-f54hz to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-w6h4g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-w6h4g to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-vq58x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-vq58x to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-v45ts

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v45ts to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-397bda-openshift-default-54899c56f9-mddj5 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-txlk4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-txlk4 to ip-10-0-139-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-sw4ms

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-sw4ms to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn to ip-10-0-138-177.ec2.internal

llm

e2e-prio-pool-14305626-kserve-57b87f7fcd-7l77s

Scheduled

Successfully assigned llm/e2e-prio-pool-14305626-kserve-57b87f7fcd-7l77s to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-smfn4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-smfn4 to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs to ip-10-0-139-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-sdbgt to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw to ip-10-0-138-177.ec2.internal

llm

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

Scheduled

Successfully assigned llm/e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb to ip-10-0-139-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-scw57

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-scw57 to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-rr9m8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rr9m8 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-q4qrg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-q4qrg to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22 to ip-10-0-139-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-pghfc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-pghfc to ip-10-0-139-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-mfjwn to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-lll9m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-lll9m to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hz6cz to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hwcsp to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-h7nkg to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-gw78n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-gw78n to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-gl57g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-gl57g to ip-10-0-139-99.ec2.internal

llm

e2e-same-id-a-d1402746-kserve-76485f7849-2kcbf

Scheduled

Successfully assigned llm/e2e-same-id-a-d1402746-kserve-76485f7849-2kcbf to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b5496290-openshift-default-786dddd54f-tplpl to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7 to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-frvgg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-frvgg to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t to ip-10-0-138-160.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-8lvxr

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-8lvxr to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-flqhx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-flqhx to ip-10-0-139-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-fh868

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fh868 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65 to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-czkn2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-czkn2 to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-c99g8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-c99g8 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-rcvcx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-rcvcx to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-9vqv8 to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp to ip-10-0-138-177.ec2.internal

llm

e2e-same-id-a-d1402746

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-d1402746

llm

e2e-same-id-b-d1402746-kserve-6d7cddc457-kgq2k

Scheduled

Successfully assigned llm/e2e-same-id-b-d1402746-kserve-6d7cddc457-kgq2k to ip-10-0-138-160.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6fd5fcc55cqc8j2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cqc8j2 to ip-10-0-138-177.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-b54c6978-g9qqq

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-b54c6978-g9qqq to ip-10-0-139-99.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-b54c6978-d2r86

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-b54c6978-d2r86 to ip-10-0-138-177.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-b54c6978-9tgc5

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-b54c6978-9tgc5 to ip-10-0-138-160.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-mb5bq

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mb5bq to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7 to ip-10-0-138-177.ec2.internal

openshift-jobset-operator

jobset-controller-manager-5df7965469-nxccm

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-5df7965469-nxccm to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4 to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-987vr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-987vr to ip-10-0-139-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-79qpn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-79qpn to ip-10-0-138-177.ec2.internal

opendatahub

test-curl-11264-cd7602

Scheduled

Successfully assigned opendatahub/test-curl-11264-cd7602 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-b5tbb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-b5tbb to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6a777c-59779bdb8d-hdqk2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6a777c-59779bdb8d-hdqk2 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6a777c-6454686bbb-bqxvg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6a777c-6454686bbb-bqxvg to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-763bde-77b97cc748-mw74r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-763bde-77b97cc748-mw74r to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-763bde-d79cb8b7d-d7ttk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-763bde-d79cb8b7d-d7ttk to ip-10-0-138-160.ec2.internal

opendatahub

test-curl-11264-6669e7

Scheduled

Successfully assigned opendatahub/test-curl-11264-6669e7 to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd to ip-10-0-138-177.ec2.internal

llm

e2e-same-id-b-d1402746

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-wpknt

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-wpknt to ip-10-0-138-177.ec2.internal

opendatahub

test-curl-11264-40b5de

Scheduled

Successfully assigned opendatahub/test-curl-11264-40b5de to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b1a417-6958676ccd-jmssc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b1a417-6958676ccd-jmssc to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b1a417-7479df4cc6-7jwmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b1a417-7479df4cc6-7jwmw to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-nnbhq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-nnbhq to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ca7a81-7489fddf54-bcg4c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ca7a81-7489fddf54-bcg4c to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-nxqp9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-nxqp9 to ip-10-0-138-160.ec2.internal

opendatahub

test-curl-11258-bdc934

Scheduled

Successfully assigned opendatahub/test-curl-11258-bdc934 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-dbabed-7cf5655f64-d72mz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dbabed-7cf5655f64-d72mz to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-566c3724-99f7c99b-nnf89

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-566c3724-99f7c99b-nnf89 to ip-10-0-138-177.ec2.internal

opendatahub

test-curl-11258-b9778e

Scheduled

Successfully assigned opendatahub/test-curl-11258-b9778e to ip-10-0-139-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-78prl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-78prl to ip-10-0-138-177.ec2.internal

opendatahub

test-curl-11258-39b691

Scheduled

Successfully assigned opendatahub/test-curl-11258-39b691 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d to ip-10-0-138-177.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-78gqk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-78gqk to ip-10-0-138-177.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-wg2xp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-wg2xp to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-5jxq4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-5jxq4 to ip-10-0-138-177.ec2.internal

opendatahub

test-curl-11258-0cd42e

Scheduled

Successfully assigned opendatahub/test-curl-11258-0cd42e to ip-10-0-139-99.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jr5sp

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jr5sp to ip-10-0-138-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f694df8bc-27xg6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-27xg6 to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-bbrl6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1a0d3427-7c69dfbb76-bbrl6 to ip-10-0-138-160.ec2.internal

openshift-ingress

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s to ip-10-0-138-177.ec2.internal

opendatahub

test-curl-11258-0a4c2a

Scheduled

Successfully assigned opendatahub/test-curl-11258-0a4c2a to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt to ip-10-0-138-160.ec2.internal

opendatahub

test-curl-11255-e26789

Scheduled

Successfully assigned opendatahub/test-curl-11255-e26789 to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b5496290-5dbd66898-zm9gw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b5496290-5dbd66898-zm9gw to ip-10-0-139-99.ec2.internal

opendatahub

test-curl-11252-aef277

Scheduled

Successfully assigned opendatahub/test-curl-11252-aef277 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-153a44-969747556-xr6ct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-153a44-969747556-xr6ct to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-hhg4z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-hhg4z to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-71b161-668476b448-8489m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-71b161-668476b448-8489m to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-86eaa9-55b6679964-m8kkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-86eaa9-55b6679964-m8kkt to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-05f827-68c47d899d-2zzk5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-05f827-68c47d899d-2zzk5 to ip-10-0-139-99.ec2.internal

opendatahub

test-curl-11252-5d15eb

Scheduled

Successfully assigned opendatahub/test-curl-11252-5d15eb to ip-10-0-139-99.ec2.internal

opendatahub

odh-model-controller-769875db56-pxxpk

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-pxxpk to ip-10-0-138-177.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-n6b8k

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-n6b8k to ip-10-0-138-160.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-g9hm4

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-g9hm4 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-2696d8-6b6c64c76-hfq5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-2696d8-6b6c64c76-hfq5h to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-448a3a-f449fbb48-cdqxg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-448a3a-f449fbb48-cdqxg to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-wpphh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-wpphh to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb to ip-10-0-138-160.ec2.internal

llm

e2e-same-id-b-d1402746

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-d1402746

openshift-ingress

payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-m5lzm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-m5lzm to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f to ip-10-0-138-177.ec2.internal

opendatahub

maas-controller-6f4559f84c-tknlp

Scheduled

Successfully assigned opendatahub/maas-controller-6f4559f84c-tknlp to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg to ip-10-0-138-177.ec2.internal

opendatahub

maas-controller-6f4559f84c-tdxj7

Scheduled

Successfully assigned opendatahub/maas-controller-6f4559f84c-tdxj7 to ip-10-0-138-160.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-b56rr

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-b56rr to ip-10-0-138-177.ec2.internal

openshift-ingress

kube-auth-proxy-685cdf9dcb-sgtk5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-685cdf9dcb-sgtk5 to ip-10-0-138-160.ec2.internal

opendatahub

maas-controller-6f4559f84c-cb6r5

Scheduled

Successfully assigned opendatahub/maas-controller-6f4559f84c-cb6r5 to ip-10-0-138-177.ec2.internal

opendatahub

maas-controller-598cbb96dc-ltrnh

Scheduled

Successfully assigned opendatahub/maas-controller-598cbb96dc-ltrnh to ip-10-0-139-99.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-5tr78

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-5tr78 to ip-10-0-139-99.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-k6qmc

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-k6qmc to ip-10-0-139-99.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-qgl9w

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-qgl9w to ip-10-0-139-99.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-b6fxf

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-b6fxf to ip-10-0-139-99.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-vtxpc

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-vtxpc to ip-10-0-138-177.ec2.internal

opendatahub

ai-gateway-controller-79d77bcfdb-6hwnl

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-79d77bcfdb-6hwnl to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8 to ip-10-0-138-177.ec2.internal

openshift-ingress

kube-auth-proxy-685cdf9dcb-c2k7g

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-685cdf9dcb-c2k7g to ip-10-0-139-99.ec2.internal

openshift-ingress

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp to ip-10-0-138-177.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh to ip-10-0-138-160.ec2.internal

models-as-a-service

payload-processing-external-model-758758b45d-bpnfm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-758758b45d-bpnfm to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx to ip-10-0-138-160.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj to ip-10-0-138-160.ec2.internal

models-as-a-service

payload-processing-external-model-6db5744bf9-qv2bf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6db5744bf9-qv2bf to ip-10-0-138-177.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-wqdvp

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wqdvp to ip-10-0-138-177.ec2.internal

openshift-ingress

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt to ip-10-0-138-177.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-j24vr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-j24vr to ip-10-0-139-99.ec2.internal

models-as-a-service

payload-processing-external-model-669d69b768-tlqsf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-669d69b768-tlqsf to ip-10-0-139-99.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-b9hb8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-b9hb8 to ip-10-0-139-99.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58 to ip-10-0-138-177.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-7pv6t

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7pv6t to ip-10-0-138-160.ec2.internal

models-as-a-service

payload-processing-external-model-5f8949bcc5-q9m9b

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5f8949bcc5-q9m9b to ip-10-0-139-99.ec2.internal

openshift-ingress

router-default-84bd8c5fd7-885hp

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-84bd8c5fd7-885hp

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-84bd8c5fd7-885hp

Scheduled

Successfully assigned openshift-ingress/router-default-84bd8c5fd7-885hp to ip-10-0-139-99.ec2.internal

models-as-a-service

payload-processing-external-model-56fd9d7c8c-bjhwk

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-56fd9d7c8c-bjhwk to ip-10-0-138-177.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-84bd8c5fd7 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-84bd8c5fd7

SuccessfulCreate

Created pod: router-default-84bd8c5fd7-885hp
(x5)

openshift-ingress

kubelet

router-default-84bd8c5fd7-885hp

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-84bd8c5fd7-885hp

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-84bd8c5fd7-885hp

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-84bd8c5fd7-885hp

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-84bd8c5fd7-885hp

Created

Container created

openshift-ingress

kubelet

router-default-84bd8c5fd7-885hp

Started

Container started
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-wg2xp

AddedInterface

Add eth0 [10.134.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-wg2xp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-wg2xp

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-wg2xp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.216s (3.216s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-wg2xp

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-wg2xp

Created

Container created

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-7cc4b68895 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-7cc4b68895

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-7cc4b68895-sxj66

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-9vqv8

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-wg2xp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-wg2xp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-7cc4b68895-sxj66

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cc4b68895-sxj66

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.154s (8.154s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cc4b68895-sxj66

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cc4b68895-sxj66

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cc4b68895-sxj66

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.209s (8.209s including waiting). Image size: 183555333 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-b54c6978

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-b54c6978-9tgc5

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-b54c6978

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-b54c6978-d2r86

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-b54c6978 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-b54c6978

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-b54c6978-g9qqq

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-b54c6978-9tgc5

AddedInterface

Add eth0 [10.134.0.14/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-9tgc5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-g9qqq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-d2r86

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-b54c6978-d2r86

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-b54c6978-g9qqq

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-9tgc5

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-d2r86

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-9tgc5

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-g9qqq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-9tgc5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.705s (2.706s including waiting). Image size: 273709574 bytes.

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-d2r86

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-g9qqq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.876s (2.876s including waiting). Image size: 273709574 bytes.
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-d2r86

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.81s (2.81s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-g9qqq

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-9tgc5

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-9tgc5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-9tgc5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 459ms (459ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-g9qqq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-g9qqq

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-g9qqq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 363ms (363ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-g9qqq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-9tgc5

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-b54c6978-g9qqq_f8bd86e7-b63d-4ee6-b776-69719bbd9204

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-b54c6978-g9qqq_f8bd86e7-b63d-4ee6-b776-69719bbd9204 became leader

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-mvz4d

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-d2r86

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-mvz4d

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-d2r86

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-d2r86

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b54c6978-d2r86

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 366ms (366ms including waiting). Image size: 273709574 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-mvz4d

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-c4zkg

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-c4zkg

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-mvz4d

Started

Container started
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-mvz4d

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.731s (2.731s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-mvz4d

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-c4zkg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-c4zkg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.571s (2.571s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-c4zkg

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

install-sjvzh

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-c4zkg

Created

Container created
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

authorino-operator-7b7bb4bc77-c4zkg_04cad8e5-7968-4073-aa51-bb27fb9a318c

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-c4zkg_04cad8e5-7968-4073-aa51-bb27fb9a318c became leader

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bd9vx

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-bd9vx

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-bd9vx

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-pg5vv

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-pg5vv
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-pg5vv

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bd9vx

Started

Container started

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-wf5lc

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bd9vx

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bd9vx

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.885s (2.885s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-pg5vv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.928s (1.928s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-pg5vv

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-pg5vv

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-wf5lc

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

dns-operator-controller-manager-8557cbdb84-pg5vv_4c6b8c98-16b0-4f85-b94c-5a344b826485

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-pg5vv_4c6b8c98-16b0-4f85-b94c-5a344b826485 became leader

cert-manager

multus

cert-manager-597b95cb84-wf5lc

AddedInterface

Add eth0 [10.134.0.15/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-8lvxr

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-8lvxr

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-8lvxr

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-597b95cb84-wf5lc

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.728s (5.728s including waiting). Image size: 309650901 bytes.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-7pv2q

cert-manager

kubelet

cert-manager-597b95cb84-wf5lc

Created

Container created

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-7pv2q

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

kubelet

cert-manager-597b95cb84-wf5lc

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7pv2q

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-mjlc5

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-8lvxr

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.832s (3.832s including waiting). Image size: 224874686 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-8lvxr

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-8lvxr

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-8lvxr_e6701e25-2fd9-4b49-9724-3dd61647be9d became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-mjlc5

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-mjlc5

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7pv2q

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.952s (3.952s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7pv2q_02b9c989-9c77-4a6f-b8c7-f7ade3480f34

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-7pv2q_02b9c989-9c77-4a6f-b8c7-f7ade3480f34 became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7pv2q

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7pv2q

Started

Container started

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-vmffb

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-vmffb

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-vmffb

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-mjlc5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 5.303s (5.303s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-mjlc5

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-mjlc5

Started

Container started

kuadrant-system

limitador-operator-controller-manager-5778bb4449-mjlc5_41c5a7ae-3c6c-4106-a918-61c4bca24f09

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-mjlc5_41c5a7ae-3c6c-4106-a918-61c4bca24f09 became leader

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-vmffb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.469s (4.469s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-vmffb

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-vmffb

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6fd5fcc55c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6fd5fcc55cqc8j2

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6fd5fcc55c from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-685cdf9dcb

SuccessfulCreate

Created pod: kube-auth-proxy-685cdf9dcb-c2k7g

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-685cdf9dcb

SuccessfulCreate

Created pod: kube-auth-proxy-685cdf9dcb-sgtk5

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-685cdf9dcb from 0 to 2

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6fd5fcc55cqc8j2

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6fd5fcc55cqc8j2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6fd5fcc55cqc8j2

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

multus

kube-auth-proxy-685cdf9dcb-sgtk5

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-685cdf9dcb-sgtk5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6fd5fcc55cqc8j2

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-685cdf9dcb-c2k7g

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-685cdf9dcb-c2k7g

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-685cdf9dcb-c2k7g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.56s (2.56s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-685cdf9dcb-c2k7g

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-685cdf9dcb-c2k7g

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-685cdf9dcb-sgtk5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.348s (2.348s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-685cdf9dcb-sgtk5

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-685cdf9dcb-sgtk5

Started

Container started

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-qgl9w

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-qgl9w

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-qgl9w

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-qgl9w

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-qgl9w

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-qgl9w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.406s (1.406s including waiting). Image size: 195729000 bytes.

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-p7pbx"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-2rsfg"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-5df7965469 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-5df7965469

SuccessfulCreate

Created pod: jobset-controller-manager-5df7965469-nxccm

openshift-jobset-operator

kubelet

jobset-controller-manager-5df7965469-nxccm

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-5df7965469-nxccm

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-5df7965469-nxccm

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.128s (3.128s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-5df7965469-nxccm

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-5df7965469-nxccm

Started

Container started

openshift-jobset-operator

jobset-controller-manager-5df7965469-nxccm_ee185420-8d94-4746-87e3-dc0129f24e4e

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-5df7965469-nxccm_ee185420-8d94-4746-87e3-dc0129f24e4e became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kserve-module-controller-manager-7566cf5fc8-qgl9w_31cb8011-38c1-400c-9f0c-fcee12aaaf34

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-qgl9w_31cb8011-38c1-400c-9f0c-fcee12aaaf34 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-7pv6t

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-7pv6t

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-b6fxf

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7pv6t

Started

Container started

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-5tr78

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7pv6t

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7pv6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-pxxpk

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-g9hm4

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5tr78

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

model-serving-api-75bd89fdfc-g9hm4

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

kserve-controller-manager-776cc66d47-b6fxf

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-wg2xp

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-5tr78

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-b6fxf

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-wg2xp

Killing

Stopping container discovery

opendatahub

multus

model-serving-api-75bd89fdfc-g9hm4

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

odh-model-controller-769875db56-pxxpk

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-pxxpk

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-b6fxf

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-b6fxf

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.613s (2.613s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5tr78

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5tr78

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.415s (2.415s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-pxxpk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.499s (2.499s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-pxxpk

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-g9hm4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.183s (2.183s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-pxxpk

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5tr78

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-g9hm4

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-g9hm4

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-b6fxf

Started

Container started

opendatahub

odh-model-controller-769875db56-pxxpk_160b600a-7d6a-4766-b406-3c95715d5cf8

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-pxxpk_160b600a-7d6a-4766-b406-3c95715d5cf8 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-5tr78_9ba2e8ef-f7aa-4632-ace4-67995bc0b5c1

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-5tr78_9ba2e8ef-f7aa-4632-ace4-67995bc0b5c1 became leader

opendatahub

kserve-controller-manager-776cc66d47-b6fxf_3c146152-a9a5-46ee-b8d3-aff0fa9c3eb6

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-b6fxf_3c146152-a9a5-46ee-b8d3-aff0fa9c3eb6 became leader
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-tcmbg

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7pv2q

Killing

Stopping container manager

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-tcmbg

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-tcmbg

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-tcmbg

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-tcmbg

Started

Container started

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-tcmbg_4669b987-220f-4d97-99cd-6ab0a3e527f4

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-tcmbg_4669b987-220f-4d97-99cd-6ab0a3e527f4 became leader

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-k9mm7

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-pnhp4

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

multus

limitador-limitador-74dfcfb894-k9mm7

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-k9mm7

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

multus

authorino-57f7f8659f-pnhp4

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-m6qxl

kuadrant-system

kubelet

authorino-57f7f8659f-pnhp4

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-vg5td

kuadrant-system

kubelet

authorino-56c6c9ddd5-m6qxl

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-m6qxl

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vg5td

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-7c9b87d574-vg5td

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-m6qxl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.399s (1.399s including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-pnhp4

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vg5td

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-k9mm7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.902s (2.902s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-k9mm7

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vg5td

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-m6qxl

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-m6qxl

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-k9mm7

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vg5td

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.354s (1.354s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-pnhp4

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-57f7f8659f-pnhp4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.762s (2.762s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-pnhp4

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-pnhp4

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-k9mm7

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-k9mm7

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

opendatahub

multus

maas-controller-598cbb96dc-ltrnh

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-598cbb96dc

SuccessfulCreate

Created pod: maas-controller-598cbb96dc-ltrnh

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-598cbb96dc from 0 to 1

opendatahub

replicaset-controller

maas-controller-6f4559f84c

SuccessfulCreate

Created pod: maas-controller-6f4559f84c-tknlp

opendatahub

kubelet

maas-controller-598cbb96dc-ltrnh

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:265e8f5f239e521a0d192c2629db6e2d85bea5ce812ae154b0a825cc5af46b66"

opendatahub

kubelet

maas-controller-6f4559f84c-tknlp

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:265e8f5f239e521a0d192c2629db6e2d85bea5ce812ae154b0a825cc5af46b66"

opendatahub

multus

maas-controller-6f4559f84c-tknlp

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-598cbb96dc-ltrnh

Created

Container created

opendatahub

kubelet

maas-controller-598cbb96dc-ltrnh

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:265e8f5f239e521a0d192c2629db6e2d85bea5ce812ae154b0a825cc5af46b66" in 2.797s (2.797s including waiting). Image size: 200057366 bytes.

opendatahub

kubelet

maas-controller-598cbb96dc-ltrnh

Started

Container started

opendatahub

kubelet

maas-controller-6f4559f84c-tknlp

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:265e8f5f239e521a0d192c2629db6e2d85bea5ce812ae154b0a825cc5af46b66" in 2.67s (2.67s including waiting). Image size: 200057366 bytes.

opendatahub

kubelet

maas-controller-6f4559f84c-tknlp

Created

Container created

opendatahub

kubelet

maas-controller-6f4559f84c-tknlp

Started

Container started

opendatahub

maas-controller-598cbb96dc-ltrnh_c1fc616c-f78c-4c06-a980-71518ac304a7

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-598cbb96dc-ltrnh_c1fc616c-f78c-4c06-a980-71518ac304a7 became leader

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-mb5bq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-mb5bq

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-mb5bq

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-598cbb96dc from 1 to 0

opendatahub

kubelet

maas-controller-598cbb96dc-ltrnh

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-598cbb96dc

SuccessfulDelete

Deleted pod: maas-controller-598cbb96dc-ltrnh

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-mb5bq

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-mb5bq

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.267s (10.267s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-mb5bq

Started

Container started

opendatahub

maas-controller-6f4559f84c-tknlp_9a24f951-789a-451e-8a32-2de67037c4e8

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6f4559f84c-tknlp_9a24f951-789a-451e-8a32-2de67037c4e8 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-57jln

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

multus

authorino-65f8dc9b64-t2xjq

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-nvhp8

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-65f8dc9b64 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-nvhp8

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-57jln

kuadrant-system

replicaset-controller

authorino-65f8dc9b64

SuccessfulCreate

Created pod: authorino-65f8dc9b64-t2xjq

kuadrant-system

kubelet

authorino-65f8dc9b64-t2xjq

Started

Container started

kuadrant-system

kubelet

authorino-65f8dc9b64-t2xjq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 504ms (504ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-65f8dc9b64-t2xjq

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Created

Container created

kuadrant-system

kubelet

authorino-65f8dc9b64-t2xjq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-m6qxl

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-m6qxl

Killing

Stopping container authorino

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-k6qmc

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-k6qmc
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

llmisvc-controller-manager-6466c554d8-k6qmc

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-k6qmc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 325ms (325ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-k6qmc

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-k6qmc

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

ProbeError

Startup probe error: Get "http://10.133.0.15:15021/healthz/ready": dial tcp 10.133.0.15:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Unhealthy

Startup probe failed: Get "http://10.133.0.15:15021/healthz/ready": dial tcp 10.133.0.15:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-78prl

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-frvgg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-sdbgt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 1 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78prl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-frvgg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78prl

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-78prl

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78prl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-frvgg

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-frvgg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.573s (2.573s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-frvgg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.668s (2.668s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-frvgg

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78prl

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78prl

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-frvgg

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-frvgg

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-x8gd4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-scw57

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-flqhx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-xfldb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-xfldb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-xfldb

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-scw57

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-scw57

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-scw57

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-xfldb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-flqhx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-scw57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-flqhx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-flqhx

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-flqhx

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-xfldb

Created

Container created

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-5tr78

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5tr78

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-vtxpc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-vtxpc

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-vtxpc
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-flqhx

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-xfldb

Unhealthy

Startup probe failed: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-xfldb

ProbeError

Startup probe error: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

Unhealthy

Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

ProbeError

Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-scw57

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-scw57

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-flqhx

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

opendatahub

kubelet

ai-gateway-controller-7d85675f98-vtxpc

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-vtxpc

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-vtxpc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.737s (2.737s including waiting). Image size: 183888297 bytes.

opendatahub

ai-gateway-controller-7d85675f98-vtxpc_48337ae9-0bd2-4a17-bff7-ffe310a47170

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-vtxpc_48337ae9-0bd2-4a17-bff7-ffe310a47170 became leader

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-v7lnv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-l4r5r

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-v7lnv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-5f78687d5b-l4r5r

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-v7lnv

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-l4r5r

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-v7lnv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-v7lnv

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-l4r5r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-v7lnv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.198s (2.198s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-l4r5r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.159s (2.159s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-l4r5r

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-w6h4g

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-txlk4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-txlk4

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-w6h4g

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-w6h4g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-txlk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-txlk4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-w6h4g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-txlk4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-w6h4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-79d77bcfdb from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-79d77bcfdb

SuccessfulCreate

Created pod: ai-gateway-controller-79d77bcfdb-6hwnl

opendatahub

kubelet

ai-gateway-controller-79d77bcfdb-6hwnl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 373ms (373ms including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-79d77bcfdb-6hwnl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-79d77bcfdb-6hwnl

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-79d77bcfdb-6hwnl

Started

Container started

opendatahub

kubelet

ai-gateway-controller-79d77bcfdb-6hwnl

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-w6h4g

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-txlk4

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-w6h4g

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-txlk4

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

opendatahub

llmisvc-controller-manager-6466c554d8-k6qmc_d0ea0e16-f67b-4ee2-bcbb-d35768439523

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-k6qmc_d0ea0e16-f67b-4ee2-bcbb-d35768439523 became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-vtxpc

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-vtxpc

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-df9pk

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-df9pk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-df9pk

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-df9pk

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-df9pk

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-df9pk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.538s (1.538s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-xxxsx

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-xxxsx

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xxxsx

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xxxsx

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 182ms (182ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xxxsx

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xxxsx

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-l8nmh

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-l8nmh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-l8nmh

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-l8nmh

Created

Container created

opendatahub

ai-gateway-controller-79d77bcfdb-6hwnl_7137240a-9dd7-4b83-8ed1-669ccc8f802d

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-79d77bcfdb-6hwnl_7137240a-9dd7-4b83-8ed1-669ccc8f802d became leader

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-l8nmh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.138s (1.138s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-l8nmh

Started

Container started

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-wpknt

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-wpknt

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-wpknt

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-wpknt

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-wpknt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-wpknt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 165ms (165ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jr5sp

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jr5sp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 234ms (234ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jr5sp

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jr5sp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jr5sp

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jr5sp

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-n6b8k

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-n6b8k

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-n6b8k

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-b56rr

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-b56rr

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-b56rr

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-b56rr

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 183ms (183ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-b56rr

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-b56rr

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-n6b8k

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.234s (2.234s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-n6b8k

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-n6b8k

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-wqdvp

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-wqdvp

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wqdvp

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wqdvp

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wqdvp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 174ms (174ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-wqdvp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Unhealthy

Readiness probe failed: Get "http://10.133.0.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

ProbeError

Readiness probe error: Get "http://10.133.0.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-757f4bf64c

SuccessfulCreate

Created pod: authorino-757f4bf64c-szwjz

kuadrant-system

multus

authorino-757f4bf64c-szwjz

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-757f4bf64c-szwjz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-757f4bf64c-szwjz

Created

Container created

kuadrant-system

replicaset-controller

authorino-65f8dc9b64

SuccessfulDelete

Deleted pod: authorino-65f8dc9b64-t2xjq

kuadrant-system

kubelet

authorino-757f4bf64c-szwjz

Started

Container started

kuadrant-system

kubelet

authorino-757f4bf64c-szwjz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 488ms (488ms including waiting). Image size: 204096810 bytes.
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-65f8dc9b64 from 1 to 0

kuadrant-system

kubelet

authorino-65f8dc9b64-t2xjq

Killing

Stopping container authorino

openshift-ingress

gateway_labeler_controller

e2e-ait-de5733f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-de5733f9

openshift-ingress

gateway_labeler_controller

e2e-ait-eb861bd9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-eb861bd9

openshift-ingress

multus

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-eb861bd9-openshift-default-7846766d9f

SuccessfulCreate

Created pod: e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

openshift-ingress

multus

e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-de5733f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-de5733f9-openshift-default-79d8fd4dcc from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf

SuccessfulCreate

Created pod: e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

openshift-ingress

replicaset-controller

e2e-ait-de5733f9-openshift-default-79d8fd4dcc

SuccessfulCreate

Created pod: e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

openshift-ingress

deployment-controller

e2e-migrate-566c3724-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-566c3724-gw-openshift-default-777b96bbdf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-566c3724-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-566c3724-gw

openshift-ingress

deployment-controller

e2e-ait-eb861bd9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-eb861bd9-openshift-default-7846766d9f from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-ad07bf73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ad07bf73-openshift-default-6c8fddcf7c from 0 to 1

openshift-ingress

multus

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c

SuccessfulCreate

Created pod: e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

openshift-ingress

gateway_labeler_controller

e2e-ait-ad07bf73

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ad07bf73

openshift-ingress

multus

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eb861bd9-989d48df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-eb861bd9-989d48df5-j2fzh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eb861bd9-5b6494876d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-eb861bd9-5b6494876d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eb861bd9: serviceaccount "payload-processing-e2e-ait-eb861bd9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-eb861bd9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-eb861bd9-5b6494876d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eb861bd9-5b6494876d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-eb861bd9-5b6494876d-zwftz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-eb861bd9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-eb861bd9-989d48df5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eb861bd9-989d48df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-eb861bd9-989d48df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eb861bd9: serviceaccount "payload-processing-e2e-ait-eb861bd9" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-eb861bd9-989d48df5-j2fzh

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-de5733f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-de5733f9-55fc6fc67d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eb861bd9-989d48df5-j2fzh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eb861bd9-989d48df5-j2fzh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eb861bd9-989d48df5-j2fzh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-eb861bd9-5b6494876d-zwftz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-eb861bd9-5b6494876d-zwftz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-eb861bd9-5b6494876d-zwftz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-eb861bd9-5b6494876d-zwftz

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-de5733f9-55fc6fc67d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-de5733f9-55fc6fc67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-de5733f9: serviceaccount "payload-processing-e2e-ait-de5733f9" not found

openshift-ingress

multus

payload-processing-e2e-ait-de5733f9-55fc6fc67d-fcfmt

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-de5733f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-de5733f9-744cdf6475 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-de5733f9-744cdf6475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-de5733f9-744cdf6475-c6fkx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-de5733f9-744cdf6475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-de5733f9-744cdf6475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-de5733f9: serviceaccount "payload-processing-e2e-ait-de5733f9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de5733f9-744cdf6475-c6fkx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de5733f9-744cdf6475-c6fkx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-de5733f9-744cdf6475-c6fkx

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-de5733f9-55fc6fc67d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-de5733f9-55fc6fc67d-fcfmt

openshift-ingress

kubelet

payload-processing-e2e-ait-de5733f9-55fc6fc67d-fcfmt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-566c3724

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-566c3724-866768ccdc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de5733f9-744cdf6475-c6fkx

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-566c3724-866768ccdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-566c3724-866768ccdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-566c3724: serviceaccount "payload-processing-e2e-migrate-566c3724" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-de5733f9-55fc6fc67d-fcfmt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-de5733f9-55fc6fc67d-fcfmt

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-566c3724

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-566c3724-99f7c99b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-566c3724-99f7c99b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-566c3724-99f7c99b-nnf89
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-566c3724-99f7c99b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-566c3724-99f7c99b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-566c3724: serviceaccount "payload-processing-e2e-migrate-566c3724" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-566c3724-866768ccdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-566c3724-866768ccdc-j265f

openshift-ingress

multus

payload-pre-processing-e2e-migrate-566c3724-866768ccdc-j265f

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-566c3724-866768ccdc-j265f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-566c3724-99f7c99b-nnf89

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-566c3724-99f7c99b-nnf89

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-566c3724-866768ccdc-j265f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-566c3724-99f7c99b-nnf89

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-566c3724-866768ccdc-j265f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-566c3724-99f7c99b-nnf89

Created

Container created

openshift-ingress

replicaset-controller

e2e-derive-cb1a18be-openshift-default-5f858dbfb5

SuccessfulCreate

Created pod: e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

openshift-ingress

gateway_labeler_controller

e2e-derive-cb1a18be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-cb1a18be
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ad07bf73-6cc664945f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ad07bf73: serviceaccount "payload-processing-e2e-ait-ad07bf73" not found

openshift-ingress

deployment-controller

e2e-derive-cb1a18be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-cb1a18be-openshift-default-5f858dbfb5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ad07bf73-574bf7494b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ad07bf73-574bf7494b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ad07bf73: serviceaccount "payload-processing-e2e-ait-ad07bf73" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ad07bf73

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ad07bf73-574bf7494b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ad07bf73

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ad07bf73-6cc664945f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ad07bf73-6cc664945f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-2cpp4

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-2cpp4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-ad07bf73-574bf7494b-6dksz

Started

Container started

openshift-ingress

multus

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ad07bf73-574bf7494b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ad07bf73-574bf7494b-6dksz

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-2cpp4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-2cpp4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-ad07bf73-574bf7494b-6dksz

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ad07bf73-574bf7494b-6dksz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-ad07bf73-574bf7494b-6dksz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-2cpp4

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-cb1a18be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-cb1a18be: serviceaccount "payload-processing-e2e-derive-cb1a18be" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-de5733f9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-de5733f9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-566c3724-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-566c3724-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-cb1a18be-dd97f446b

FailedCreate

Error creating: pods "payload-processing-e2e-derive-cb1a18be-dd97f446b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-cb1a18be: serviceaccount "payload-processing-e2e-derive-cb1a18be" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-cb1a18be-dd97f446b

SuccessfulCreate

Created pod: payload-processing-e2e-derive-cb1a18be-dd97f446b-j2p8n

openshift-ingress

deployment-controller

payload-processing-e2e-derive-cb1a18be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-cb1a18be-dd97f446b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-9nhwj

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-9nhwj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-cb1a18be-dd97f446b-j2p8n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-9nhwj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-cb1a18be-dd97f446b-j2p8n

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-9nhwj

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-cb1a18be-dd97f446b-j2p8n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-9nhwj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-cb1a18be-dd97f446b-j2p8n

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

Unhealthy

Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

ProbeError

Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-cb1a18be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-cb1a18be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eb861bd9-989d48df5-j2fzh

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-eb861bd9-5b6494876d-zwftz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-566c3724-99f7c99b-nnf89

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-566c3724-866768ccdc-j265f

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-eb861bd9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-eb861bd9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-de5733f9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-566c3724-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-de5733f9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-566c3724-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ad07bf73-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ad07bf73-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de5733f9-744cdf6475-c6fkx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-de5733f9-55fc6fc67d-fcfmt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

Started

Container started

openshift-ingress

kubelet

e2e-migrate-566c3724-gw-openshift-default-777b96bbdf-zh77d

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-5d74b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-5d74b9

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-b4708a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-b4708a

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-cb1a18be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-de5733f9-openshift-default-79d8fd4dcc-hpkdb

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-cb1a18be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w4-a2f984-openshift-default-c678cb5cc

SuccessfulCreate

Created pod: e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

openshift-ingress

deployment-controller

e2e-worker-w4-a2f984-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a2f984-openshift-default-c678cb5cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-a2f984

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-a2f984

openshift-ingress

kubelet

payload-processing-e2e-ait-ad07bf73-574bf7494b-6dksz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad07bf73-6cc664945f-2cpp4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-eb861bd9-openshift-default-7846766d9f-99hd7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-5d74b9: serviceaccount "payload-processing-e2e-worker-w2-5d74b9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-5d74b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-5d74b9-58b6754b68

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-5d74b9-58b6754b68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-5d74b9: serviceaccount "payload-processing-e2e-worker-w2-5d74b9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-5d74b9-58b6754b68

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-5d74b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-5d74b9-58b6754b68 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulCreate

Created pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-b4708a-fbc8b564

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-36bbac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-36bbac

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b4708a: serviceaccount "payload-processing-e2e-worker-w3-b4708a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-b4708a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-b4708a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-b4708a-fbc8b564 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-b4708a-fbc8b564

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-b4708a-fbc8b564-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b4708a: serviceaccount "payload-processing-e2e-worker-w3-b4708a" not found

openshift-ingress

multus

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.446s (1.446s including waiting). Image size: 125317101 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-a2f984

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-a2f984-67c675d495 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a2f984-bd5b789d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.02s (3.02s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a2f984-bd5b789d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-a2f984-bd5b789d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a2f984: serviceaccount "payload-processing-e2e-worker-w4-a2f984" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-a2f984

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-a2f984-bd5b789d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.021s (3.021s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-ad07bf73-openshift-default-6c8fddcf7c-bspbl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a2f984: serviceaccount "payload-processing-e2e-worker-w4-a2f984" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-cb1a18be-94d4b77c5-9nhwj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-cb1a18be-dd97f446b-j2p8n

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-36bbac-75df4744d4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-36bbac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-36bbac-75df4744d4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-36bbac-75df4744d4

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-36bbac-75df4744d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-36bbac: serviceaccount "payload-processing-e2e-worker-w0-36bbac" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-36bbac-7479548695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-36bbac-7479548695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-36bbac: serviceaccount "payload-processing-e2e-worker-w0-36bbac" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-36bbac-7479548695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-36bbac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-36bbac-7479548695 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg

Created

Container created

openshift-ingress

kubelet

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-6796b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-6796b1

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-cb1a18be-openshift-default-5f858dbfb5-89s9h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-6796b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-6796b1-7b59f6c658 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-6796b1: serviceaccount "payload-processing-e2e-worker-w1-6796b1" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-6796b1-7b59f6c658

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-6796b1-7b59f6c658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-6796b1: serviceaccount "payload-processing-e2e-worker-w1-6796b1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-6796b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-6796b1-768bc96979 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-6796b1-7b59f6c658

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a2f984-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a2f984-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

Created

Container created

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulCreate

Created pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 1 to 3

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

Started

Container started

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

Created

Container created

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulCreate

Created pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

openshift-ingress

multus

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

Created

Container created

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 2 to 4

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-a2f984-openshift-default-c678cb5cc

SuccessfulCreate

Created pod: e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 4 to 7

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-scw57

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 10 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-scw57

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 6 to 9

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

Created

Container created

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

Started

Container started

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulCreate

Created pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

openshift-ingress

multus

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-sdbgt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 9 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-w6h4g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-w6h4g

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sdbgt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 7 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-flqhx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-frvgg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-flqhx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-frvgg

openshift-ingress

gateway_labeler_controller

e2e-mt-1a0d3427

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-1a0d3427

openshift-ingress

deployment-controller

e2e-mt-1a0d3427-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1a0d3427-openshift-default-697689cb57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-1a0d3427-openshift-default-697689cb57

SuccessfulCreate

Created pod: e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

openshift-ingress

multus

e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-9vqv8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-9vqv8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1a0d3427-7c69dfbb76

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1a0d3427: serviceaccount "payload-processing-e2e-mt-1a0d3427" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1a0d3427

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1a0d3427-67dd99d479 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1a0d3427

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1a0d3427-7c69dfbb76 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1a0d3427-7c69dfbb76

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1a0d3427-7c69dfbb76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1a0d3427: serviceaccount "payload-processing-e2e-mt-1a0d3427" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-xfldb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 4 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-xfldb

openshift-ingress

deployment-controller

e2e-api-a-e124dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e124dc-openshift-default-7b8dccd995 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-e124dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e124dc

openshift-ingress

replicaset-controller

e2e-api-a-e124dc-openshift-default-7b8dccd995

SuccessfulCreate

Created pod: e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

openshift-ingress

multus

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e124dc-96dfb687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e124dc-96dfb687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e124dc: serviceaccount "payload-processing-e2e-api-a-e124dc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e124dc-7c47449b48

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e124dc-7c47449b48-f5r48

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e124dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e124dc-96dfb687 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e124dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e124dc-7c47449b48 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e124dc-7c47449b48

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e124dc-7c47449b48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e124dc: serviceaccount "payload-processing-e2e-api-a-e124dc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e124dc-96dfb687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e124dc-96dfb687-6k6rx

openshift-ingress

multus

payload-processing-e2e-api-a-e124dc-7c47449b48-f5r48

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-e124dc-7c47449b48-f5r48

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-e124dc-7c47449b48-f5r48

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e124dc-96dfb687-6k6rx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e124dc-96dfb687-6k6rx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-e124dc-7c47449b48-f5r48

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e124dc-96dfb687-6k6rx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e124dc-96dfb687-6k6rx

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1a0d3427-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1a0d3427-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-5jxq4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-czkn2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sw4ms

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sw4ms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-sw4ms

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sw4ms

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-czkn2

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-czkn2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-czkn2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-5jxq4

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 3 to 6

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-5jxq4

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-5jxq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-e3c43b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e3c43b-openshift-default-86b776b77c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-e3c43b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e3c43b

openshift-ingress

replicaset-controller

e2e-api-a-e3c43b-openshift-default-86b776b77c

SuccessfulCreate

Created pod: e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

openshift-ingress

multus

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e3c43b-845d85c686

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e3c43b-845d85c686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e3c43b: serviceaccount "payload-processing-e2e-api-a-e3c43b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e3c43b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e3c43b-845d85c686 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e3c43b-644fb88f75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-mrvv4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e3c43b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e3c43b-644fb88f75 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e3c43b-644fb88f75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e3c43b: serviceaccount "payload-processing-e2e-api-a-e3c43b" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sw4ms

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-mrvv4

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sw4ms

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e3c43b-845d85c686

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-mrvv4

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-mrvv4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-5jxq4

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-5jxq4

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-mrvv4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt

Started

Container started
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-czkn2

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-czkn2

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-0c530e-openshift-default-65544d5499

SuccessfulCreate

Created pod: e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

openshift-ingress

gateway_labeler_controller

e2e-api-b-0c530e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0c530e

openshift-ingress

deployment-controller

e2e-api-b-0c530e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0c530e-openshift-default-65544d5499 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1a0d3427-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1a0d3427-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78gqk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78gqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-q4qrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-q4qrg

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-987vr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-987vr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-987vr

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-987vr

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-78gqk

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78gqk

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0c530e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0c530e-64d8846c56 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0c530e-98c979bbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0c530e-98c979bbc-hk7vz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0c530e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0c530e-98c979bbc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0c530e-98c979bbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0c530e-98c979bbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0c530e: serviceaccount "payload-processing-e2e-api-b-0c530e" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-q4qrg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-q4qrg

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0c530e-64d8846c56

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0c530e-64d8846c56-w64nj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0c530e-64d8846c56

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0c530e-64d8846c56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0c530e: serviceaccount "payload-processing-e2e-api-b-0c530e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0c530e-98c979bbc-hk7vz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-0c530e-64d8846c56-w64nj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-0c530e-64d8846c56-w64nj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0c530e-98c979bbc-hk7vz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0c530e-98c979bbc-hk7vz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-0c530e-64d8846c56-w64nj

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0c530e-98c979bbc-hk7vz

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0c530e-64d8846c56-w64nj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e124dc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e124dc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-q4qrg

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78gqk

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-q4qrg

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-987vr

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-987vr

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78gqk

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-397bda

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-397bda

openshift-ingress

replicaset-controller

e2e-api-b-397bda-openshift-default-54899c56f9

SuccessfulCreate

Created pod: e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

openshift-ingress

deployment-controller

e2e-api-b-397bda-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-397bda-openshift-default-54899c56f9 from 0 to 1

openshift-ingress

multus

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e3c43b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-11264-cd7602

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-11264-cd7602

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e3c43b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-397bda

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-397bda-86b6678695 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-397bda-86b6678695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-397bda-86b6678695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-397bda-86b6678695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-397bda: serviceaccount "payload-processing-e2e-api-b-397bda" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-397bda

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-397bda-65fb8d6656 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-397bda-65fb8d6656

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-397bda-65fb8d6656-ngr2l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-397bda-65fb8d6656

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-397bda-65fb8d6656-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-397bda: serviceaccount "payload-processing-e2e-api-b-397bda" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-397bda-65fb8d6656-ngr2l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-397bda-65fb8d6656-ngr2l

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-397bda-65fb8d6656-ngr2l

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11264-cd7602

Created

Container created

opendatahub

kubelet

test-curl-11264-cd7602

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.12s (2.12s including waiting). Image size: 106100986 bytes.

openshift-ingress

kubelet

payload-processing-e2e-api-b-397bda-65fb8d6656-ngr2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11264-cd7602

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused

opendatahub

kubelet

test-curl-11264-cd7602

Killing

Stopping container test-curl-11264-cd7602
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e124dc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e124dc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e124dc-96dfb687-6k6rx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e124dc-7c47449b48-f5r48

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-j24vr

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-j24vr

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j24vr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0c530e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0c530e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j24vr

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j24vr

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j24vr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.252s (3.252s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j24vr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j24vr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e3c43b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e3c43b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-a2f984-openshift-default-c678cb5cc

SuccessfulDelete

Deleted pod: e2e-worker-w4-a2f984-openshift-default-c678cb5cc-nfw65
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-474hp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-9pbd4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

Started

Container started

openshift-ingress

kubelet

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

Created

Container created

openshift-ingress

kubelet

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-e124dc-openshift-default-7b8dccd995-4xk42

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0c530e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0c530e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-0c530e-64d8846c56-w64nj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0c530e-98c979bbc-hk7vz

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulDelete

Deleted pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-8h4wj

openshift-ingress

kubelet

payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e3c43b-644fb88f75-mrvv4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e3c43b-845d85c686-6hjjt

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.67:50052" within 1s: context deadline exceeded
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-397bda-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-397bda-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-7f694df8bc-lll9m

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulDelete

Deleted pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-lll9m

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-lll9m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-lll9m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-lll9m

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-z5n8j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulDelete

Deleted pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-qlkn7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1a0d3427

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1a0d3427-67dd99d479 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-zmcx8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1a0d3427: serviceaccount "payload-processing-e2e-mt-1a0d3427" not found

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1a0d3427

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1a0d3427-7c69dfbb76 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 7 to 5

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-v9qlv

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-2z822

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1a0d3427-7c69dfbb76

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1a0d3427-7c69dfbb76-bbrl6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1a0d3427-7c69dfbb76

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1a0d3427-7c69dfbb76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1a0d3427: serviceaccount "payload-processing-e2e-mt-1a0d3427" not found

openshift-ingress

kubelet

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-api-b-0c530e-openshift-default-65544d5499-vz2fh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-zmcx8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-zmcx8

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-zmcx8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-bbrl6

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-zmcx8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-bbrl6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-bbrl6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-bbrl6

Started

Container started

openshift-ingress

kubelet

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-e3c43b-openshift-default-86b776b77c-wmtkg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-lll9m

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-lll9m

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-397bda-65fb8d6656-ngr2l

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 5 to 4

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-397bda-86b6678695-xb5wm

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.107:50052" within 1s: context deadline exceeded

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-8v6mx

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-bf4238-openshift-default-df464f8f

SuccessfulCreate

Created pod: e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

openshift-ingress

deployment-controller

e2e-ipp-a-bf4238-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bf4238-openshift-default-df464f8f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bf4238

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bf4238

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6dcea5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6dcea5

openshift-ingress

deployment-controller

e2e-ipp-a-6dcea5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6dcea5-openshift-default-5848589cc5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-6dcea5-openshift-default-5848589cc5

SuccessfulCreate

Created pod: e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bf4238

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf4238: serviceaccount "payload-processing-e2e-ipp-a-bf4238" not found

openshift-ingress

multus

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-s7svm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf4238: serviceaccount "payload-processing-e2e-ipp-a-bf4238" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-rcvcx

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bf4238

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-rcvcx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-s7svm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-s7svm

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-rcvcx

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-s7svm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-rcvcx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-rcvcx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-s7svm

Started

Container started

openshift-ingress

kubelet

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-baa474-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-baa474-openshift-default-f84445469 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-baa474

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-baa474

openshift-ingress

multus

e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-baa474-openshift-default-f84445469

SuccessfulCreate

Created pod: e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-nv59r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6dcea5: serviceaccount "payload-processing-e2e-ipp-a-6dcea5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6dcea5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6dcea5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff from 0 to 1

openshift-ingress

kubelet

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

test-curl-11264-40b5de

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11264-40b5de

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-79nmt

openshift-ingress

kubelet

e2e-api-b-397bda-openshift-default-54899c56f9-mddj5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6dcea5: serviceaccount "payload-processing-e2e-ipp-a-6dcea5" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-79nmt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-nv59r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-nv59r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-nv59r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-79nmt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-79nmt

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-nv59r

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-79nmt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11264-40b5de

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-tndqd

opendatahub

kubelet

test-curl-11264-40b5de

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.068s (2.068s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11264-40b5de

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-xhf65

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-11264-40b5de

Killing

Stopping container test-curl-11264-40b5de
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-baa474-65c6d8f6f4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-baa474: serviceaccount "payload-processing-e2e-ipp-a-baa474" not found

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-pvqj5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-baa474-65c6d8f6f4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-v4cbr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-baa474

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-baa474-65c6d8f6f4 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 9 to 5

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-4ht22

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-8rmrs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-baa474: serviceaccount "payload-processing-e2e-ipp-a-baa474" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-baa474

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-v4cbr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-v4cbr

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-v4cbr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-xhf65

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-v4cbr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-xhf65

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-xhf65

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-xhf65

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-djckm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6dcea5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6dcea5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bf4238-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bf4238-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

ProbeError

Readiness probe error: Get "http://10.133.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

Unhealthy

Readiness probe failed: Get "http://10.133.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6dfcfcdd98-rcvcx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-5df7887b75-s7svm

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

Unhealthy

Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

ProbeError

Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6dcea5-74c54fbdd8-79nmt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6dcea5-7fdfbf74ff-nv59r

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bf4238

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bf4238-6bfd8864cb from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf4238: serviceaccount "payload-processing-e2e-ipp-a-bf4238" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf4238: serviceaccount "payload-processing-e2e-ipp-a-bf4238" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bf4238

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": read tcp 10.134.0.2:52180->10.134.0.76:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": read tcp 10.134.0.2:52180->10.134.0.76:15021: read: connection reset by peer body:

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.011s (1.011s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-baa474-cb9b87fdc-xhf65

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-65c6d8f6f4-v4cbr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.295s (2.295s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a0d3427-67dd99d479-zmcx8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1a0d3427-7c69dfbb76-bbrl6

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bf4238-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bf4238-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6dcea5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6dcea5: serviceaccount "payload-processing-e2e-ipp-a-6dcea5" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6dcea5: serviceaccount "payload-processing-e2e-ipp-a-6dcea5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6dcea5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-cd55r

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-m5lzm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-cd55r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-cd55r

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-cd55r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-m5lzm

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-m5lzm

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-m5lzm

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-m5lzm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-cd55r

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 4 to 3

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-f2xf4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-baa474

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-baa474-844c576744 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-baa474-66457b6895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-baa474-66457b6895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-baa474: serviceaccount "payload-processing-e2e-ipp-a-baa474" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-baa474

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-baa474-66457b6895 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-baa474-66457b6895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-baa474-66457b6895-g8dj9

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-baa474-844c576744

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-baa474-66457b6895-g8dj9

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-baa474-844c576744

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-baa474-844c576744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-baa474: serviceaccount "payload-processing-e2e-ipp-a-baa474" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-baa474-66457b6895-g8dj9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-baa474-66457b6895-g8dj9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-baa474-66457b6895-g8dj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.406s (1.406s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-ca7a81-openshift-default-8b85498c5

SuccessfulCreate

Created pod: e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

openshift-ingress

deployment-controller

e2e-ipp-b-ca7a81-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ca7a81-openshift-default-8b85498c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ca7a81

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ca7a81

openshift-ingress

multus

e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ca7a81

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca7a81-5cd9997c64

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-nnbhq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca7a81-5cd9997c64

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca7a81: serviceaccount "payload-processing-e2e-ipp-b-ca7a81" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ca7a81

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ca7a81-5cd9997c64 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-gn2cq

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca7a81: serviceaccount "payload-processing-e2e-ipp-b-ca7a81" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-gn2cq

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b1a417

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b1a417

openshift-ingress

deployment-controller

e2e-ipp-b-b1a417-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b1a417-openshift-default-647576dbdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-b1a417-openshift-default-647576dbdf

SuccessfulCreate

Created pod: e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

openshift-ingress

multus

e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-gn2cq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-gn2cq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-nnbhq

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-nnbhq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-nnbhq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-nnbhq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-gn2cq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6dcea5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6dcea5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b1a417

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b1a417

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b1a417-6958676ccd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b1a417-6958676ccd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b1a417-6958676ccd-jmssc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b1a417-6958676ccd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b1a417-6958676ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b1a417: serviceaccount "payload-processing-e2e-ipp-b-b1a417" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b1a417: serviceaccount "payload-processing-e2e-ipp-b-b1a417" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-vrrxq

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-vrrxq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-vrrxq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-vrrxq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1a417-6958676ccd-jmssc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1a417-6958676ccd-jmssc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1a417-6958676ccd-jmssc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-b1a417-6958676ccd-jmssc

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-vrrxq

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-1a0d3427-openshift-default-697689cb57-28z5t

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-baa474-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-baa474-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-ipp-b-763bde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-763bde-openshift-default-54bfd857c9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-763bde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-763bde

openshift-ingress

replicaset-controller

e2e-ipp-b-763bde-openshift-default-54bfd857c9

SuccessfulCreate

Created pod: e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

openshift-ingress

multus

e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-763bde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-763bde-66bc8c647 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-763bde-77b97cc748

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-763bde-77b97cc748-mw74r
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-763bde-77b97cc748

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-763bde-77b97cc748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-763bde: serviceaccount "payload-processing-e2e-ipp-b-763bde" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-763bde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-763bde-77b97cc748 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-763bde-66bc8c647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-qsmkf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-763bde-66bc8c647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-763bde: serviceaccount "payload-processing-e2e-ipp-b-763bde" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-763bde-77b97cc748-mw74r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-qsmkf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-763bde-77b97cc748-mw74r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-763bde-77b97cc748-mw74r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-763bde-77b97cc748-mw74r

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-qsmkf

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-qsmkf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-qsmkf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca7a81-74bc86f77f-gn2cq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca7a81-5cd9997c64-nnbhq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1a417-7cd6c4966c-vrrxq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1a417-6958676ccd-jmssc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-f7a36d-openshift-default-5756486b57

SuccessfulCreate

Created pod: e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

openshift-ingress

deployment-controller

e2e-ipp-a-f7a36d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f7a36d-openshift-default-5756486b57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f7a36d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f7a36d

openshift-ingress

multus

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ca7a81-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ca7a81-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f7a36d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-f7rf9

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f7a36d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-b5tbb

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f7a36d: serviceaccount "payload-processing-e2e-ipp-a-f7a36d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-f7rf9

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-f7rf9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-b5tbb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-f7rf9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-f7rf9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-b5tbb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-b5tbb

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f7a36d: serviceaccount "payload-processing-e2e-ipp-a-f7a36d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-b5tbb

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ca7a81

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ca7a81-7489fddf54 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca7a81: serviceaccount "payload-processing-e2e-ipp-b-ca7a81" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca7a81-7489fddf54

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ca7a81-7489fddf54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca7a81: serviceaccount "payload-processing-e2e-ipp-b-ca7a81" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ca7a81

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-vsv9v

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca7a81-7489fddf54

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ca7a81-7489fddf54-bcg4c

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-vsv9v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-vsv9v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca7a81-7489fddf54-bcg4c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-vsv9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca7a81-7489fddf54-bcg4c

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-vsv9v

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca7a81-7489fddf54-bcg4c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-763bde-66bc8c647-qsmkf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-763bde-77b97cc748-mw74r

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-ca7a81-7489fddf54-bcg4c

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-763bde-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-763bde-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-7lvkw
(x6)

openshift-ingress

kubelet

e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

Unhealthy

Startup probe failed: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b1a417

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b1a417-7479df4cc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b1a417-7479df4cc6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b1a417-7479df4cc6-7jwmw
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b1a417: serviceaccount "payload-processing-e2e-ipp-b-b1a417" not found
(x6)

openshift-ingress

kubelet

e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

ProbeError

Startup probe error: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b1a417-7479df4cc6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b1a417-7479df4cc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b1a417: serviceaccount "payload-processing-e2e-ipp-b-b1a417" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b1a417

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-7lvkw

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1a417-7479df4cc6-7jwmw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1a417-7479df4cc6-7jwmw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1a417-7479df4cc6-7jwmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-b1a417-7479df4cc6-7jwmw

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-7lvkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-7lvkw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-7lvkw

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b1a417-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b1a417-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ca7a81-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-763bde-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-763bde-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ca7a81-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-763bde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-763bde-d79cb8b7d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-763bde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-763bde-d79cb8b7d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-763bde-d79cb8b7d-d7ttk

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-gkwvz

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-763bde: serviceaccount "payload-processing-e2e-ipp-b-763bde" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-gkwvz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-763bde-d79cb8b7d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-763bde-d79cb8b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-763bde: serviceaccount "payload-processing-e2e-ipp-b-763bde" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-763bde-d79cb8b7d-d7ttk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-gkwvz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-gkwvz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-763bde-d79cb8b7d-d7ttk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-gkwvz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-763bde-d79cb8b7d-d7ttk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-763bde-d79cb8b7d-d7ttk

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-3f5508-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3f5508-openshift-default-547b8d6877 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-3f5508-openshift-default-547b8d6877

SuccessfulCreate

Created pod: e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3f5508

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3f5508

openshift-ingress

multus

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f5508: serviceaccount "payload-processing-e2e-ipp-a-3f5508" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3f5508

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f5508: serviceaccount "payload-processing-e2e-ipp-a-3f5508" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3f5508

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3f5508-9d649549f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.467s (2.467s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.258s (2.258s including waiting). Image size: 125317101 bytes.
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf4238-6bfd8864cb-9v8jq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf4238-57c5db57f5-v9xw4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-68dc5cdcbb-b5tbb

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f7a36d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f7a36d-75986dd747-f7rf9

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f7a36d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-bf4238-openshift-default-df464f8f-5tr25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6dcea5-fd46bc8f8-cd55r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6dcea5-7dd5c45647-m5lzm

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f7a36d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f7a36d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-baa474-66457b6895-g8dj9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-baa474-844c576744-t2w9f

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f7a36d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f7a36d-5c4df657fb from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f7a36d: serviceaccount "payload-processing-e2e-ipp-a-f7a36d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-qtvjt

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f7a36d: serviceaccount "payload-processing-e2e-ipp-a-f7a36d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f7a36d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-qtvjt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-qtvjt

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-qtvjt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-qtvjt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-6dcea5-openshift-default-5848589cc5-xfd5t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-baa474-openshift-default-f84445469-wfpwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca7a81-7489fddf54-bcg4c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca7a81-5f75c99dc-vsv9v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-ca7a81-openshift-default-8b85498c5-m7hfw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1a417-7479df4cc6-7jwmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1a417-5554cbc85f-7lvkw

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-dbabed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-dbabed

openshift-ingress

replicaset-controller

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5

SuccessfulCreate

Created pod: e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

openshift-ingress

deployment-controller

e2e-praxis-a-58cdc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-58cdc8-openshift-default-846ddb74d5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-58cdc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-58cdc8

openshift-ingress

deployment-controller

e2e-ipp-b-dbabed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-dbabed-openshift-default-7cddf558b9 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-dbabed-openshift-default-7cddf558b9

SuccessfulCreate

Created pod: e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-b1a417-openshift-default-647576dbdf-tvlxz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-71b161

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-71b161

openshift-ingress

multus

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dbabed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dbabed-854d595775 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dbabed-5d5d4d9966

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dbabed: serviceaccount "payload-processing-e2e-ipp-b-dbabed" not found

openshift-ingress

replicaset-controller

e2e-praxis-a-71b161-openshift-default-59949694fc

SuccessfulCreate

Created pod: e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

openshift-ingress

deployment-controller

e2e-praxis-a-71b161-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-71b161-openshift-default-59949694fc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dbabed-854d595775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dbabed-854d595775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dbabed: serviceaccount "payload-processing-e2e-ipp-b-dbabed" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dbabed-854d595775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dbabed-854d595775-9fmt4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dbabed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dbabed-5d5d4d9966 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-nxqp9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dbabed-854d595775-9fmt4

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-nxqp9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-nxqp9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-nxqp9

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3f5508-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3f5508-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dbabed-5d5d4d9966

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-nxqp9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-58cdc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbabed-854d595775-9fmt4

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-58cdc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-58cdc8-697cf6d99d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-58cdc8-697cf6d99d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-hhg4z

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-6c8d9cbd78-rgj9l

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.87:50052" within 1s: context deadline exceeded

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-sd87n

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbabed-854d595775-9fmt4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-58cdc8: serviceaccount "payload-processing-e2e-praxis-a-58cdc8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-58cdc8-697cf6d99d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-58cdc8: serviceaccount "payload-processing-e2e-praxis-a-58cdc8" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-763bde-d79cb8b7d-d7ttk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbabed-854d595775-9fmt4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-9d649549f-kmwcv

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.86:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-hhg4z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-sd87n

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-hhg4z

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-763bde-77f9dc9ff9-gkwvz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-sd87n

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

ProbeError

Startup probe error: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-sd87n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-sd87n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-hhg4z

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

Unhealthy

Startup probe failed: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-hhg4z

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-71b161

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-71b161-668476b448 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-wdcgr

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-wdcgr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-71b161-575fcb688c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-71b161: serviceaccount "payload-processing-e2e-praxis-a-71b161" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-wdcgr

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-71b161-668476b448-8489m

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-71b161-668476b448

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-71b161-668476b448-8489m

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-wdcgr

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-71b161

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-71b161-575fcb688c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-71b161-668476b448

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-71b161-668476b448-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-71b161: serviceaccount "payload-processing-e2e-praxis-a-71b161" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-71b161-575fcb688c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-wdcgr

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-71b161-668476b448-8489m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-71b161-668476b448-8489m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-71b161-668476b448-8489m

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3f5508

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3f5508

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3f5508-69d86d8b84 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-wdjwj

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-wdjwj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f5508-69d86d8b84

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3f5508-69d86d8b84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f5508: serviceaccount "payload-processing-e2e-ipp-a-3f5508" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f5508-69d86d8b84

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3f5508-69d86d8b84-nvfm6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f5508: serviceaccount "payload-processing-e2e-ipp-a-3f5508" not found

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-69d86d8b84-nvfm6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-69d86d8b84-nvfm6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-69d86d8b84-nvfm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-wdjwj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-3f5508-69d86d8b84-nvfm6

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-wdjwj

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulDelete

Deleted pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-zqvhh

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-wdjwj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-763bde-openshift-default-54bfd857c9-vrb4w

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-71b161-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-71b161-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-a-153a44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-153a44-openshift-default-57c49f9997 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-153a44

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-153a44

openshift-ingress

replicaset-controller

e2e-praxis-a-153a44-openshift-default-57c49f9997

SuccessfulCreate

Created pod: e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

openshift-ingress

multus

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-153a44: serviceaccount "payload-processing-e2e-praxis-a-153a44" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-153a44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-153a44-969747556 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-153a44-969747556

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-153a44-969747556-xr6ct
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-153a44-969747556

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-153a44-969747556-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-153a44: serviceaccount "payload-processing-e2e-praxis-a-153a44" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-153a44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-153a44-7d899665f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-153a44-969747556-xr6ct

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-153a44-969747556-xr6ct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-153a44-969747556-xr6ct

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-153a44-969747556-xr6ct

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-58cdc8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-58cdc8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc

SuccessfulCreate

Created pod: e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6a777c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6a777c

openshift-ingress

deployment-controller

e2e-ipp-b-6a777c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6a777c-openshift-default-597bb4b5dc from 0 to 1

openshift-ingress

multus

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3f5508-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3f5508-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-153a44-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-153a44-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-snwbg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6a777c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6a777c-59779bdb8d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6a777c-59779bdb8d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6a777c-59779bdb8d-hdqk2
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6a777c-59779bdb8d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6a777c-59779bdb8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6a777c: serviceaccount "payload-processing-e2e-ipp-b-6a777c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6a777c: serviceaccount "payload-processing-e2e-ipp-b-6a777c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6a777c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-6a777c-59779bdb8d-hdqk2

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a777c-59779bdb8d-hdqk2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a777c-59779bdb8d-hdqk2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-snwbg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-snwbg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-snwbg

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a777c-59779bdb8d-hdqk2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-snwbg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbabed-854d595775-9fmt4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbabed-5d5d4d9966-nxqp9

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-eb9d23

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-eb9d23

openshift-ingress

replicaset-controller

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c

SuccessfulCreate

Created pod: e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

openshift-ingress

deployment-controller

e2e-praxis-b-eb9d23-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c from 0 to 1

openshift-ingress

multus

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-05f827-openshift-default-6589fdcf57

SuccessfulCreate

Created pod: e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

openshift-ingress

deployment-controller

e2e-praxis-b-05f827-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-05f827-openshift-default-6589fdcf57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-05f827

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-05f827

openshift-ingress

multus

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-eb9d23

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-eb9d23: serviceaccount "payload-processing-e2e-praxis-b-eb9d23" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-eb9d23: serviceaccount "payload-processing-e2e-praxis-b-eb9d23" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-eb9d23

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-wpphh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-2kfrx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-2kfrx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-2kfrx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-2kfrx

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-wpphh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-2kfrx

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-wpphh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-wpphh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-wpphh

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-05f827

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-bbdgh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-05f827: serviceaccount "payload-processing-e2e-praxis-b-05f827" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-05f827

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-05f827-68c47d899d from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-05f827-68c47d899d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-05f827-68c47d899d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-05f827: serviceaccount "payload-processing-e2e-praxis-b-05f827" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-05f827-68c47d899d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-05f827-68c47d899d-2zzk5
(x6)

openshift-ingress

kubelet

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-bbdgh

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-05f827-68c47d899d-2zzk5

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-bbdgh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-05f827-68c47d899d-2zzk5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-bbdgh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-bbdgh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-05f827-68c47d899d-2zzk5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-05f827-68c47d899d-2zzk5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-gr45s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dbabed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dbabed-7cf5655f64 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dbabed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dbabed-865cf4767 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dbabed-865cf4767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-v4c6p
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dbabed-865cf4767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dbabed: serviceaccount "payload-processing-e2e-ipp-b-dbabed" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dbabed-7cf5655f64

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dbabed-7cf5655f64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dbabed: serviceaccount "payload-processing-e2e-ipp-b-dbabed" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dbabed-7cf5655f64

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dbabed-7cf5655f64-d72mz

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbabed-7cf5655f64-d72mz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbabed-7cf5655f64-d72mz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-dbabed-7cf5655f64-d72mz

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-v4c6p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-v4c6p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbabed-7cf5655f64-d72mz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-v4c6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-v4c6p

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dbabed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dbabed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-448a3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-448a3a

openshift-ingress

deployment-controller

e2e-praxis-b-448a3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-448a3a-openshift-default-6cc5f9c945 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945

SuccessfulCreate

Created pod: e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

openshift-ingress

multus

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-71b161-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-71b161-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-448a3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-448a3a-f449fbb48 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-448a3a-559597875-cxb2w

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-448a3a-559597875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-448a3a-559597875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-448a3a: serviceaccount "payload-processing-e2e-praxis-b-448a3a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-448a3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-448a3a-559597875 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-448a3a-559597875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-448a3a-559597875-cxb2w

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-448a3a-559597875-cxb2w

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-448a3a-559597875-cxb2w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-448a3a-559597875-cxb2w

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-448a3a-f449fbb48

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-448a3a-f449fbb48-cdqxg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-448a3a-f449fbb48

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-448a3a-f449fbb48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-448a3a: serviceaccount "payload-processing-e2e-praxis-b-448a3a" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-448a3a-f449fbb48-cdqxg

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-448a3a-f449fbb48-cdqxg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-448a3a-f449fbb48-cdqxg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-448a3a-f449fbb48-cdqxg

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

Unhealthy

Readiness probe failed: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

ProbeError

Readiness probe error: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-58cdc8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-58cdc8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a777c-59779bdb8d-hdqk2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a777c-7c546b744c-snwbg

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6a777c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6a777c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 5 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-hpmf7

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-zmjw6

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

ProbeError

Readiness probe error: Get "http://10.133.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

Unhealthy

Readiness probe failed: Get "http://10.133.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

Unhealthy

Startup probe failed: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

ProbeError

Startup probe error: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-eb9d23-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-eb9d23-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-153a44-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-153a44-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6a777c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6a777c-6454686bbb from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

Unhealthy

Readiness probe failed: Get "http://10.133.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

ProbeError

Readiness probe error: Get "http://10.133.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-z2g7s

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6a777c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6a777c: serviceaccount "payload-processing-e2e-ipp-b-6a777c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6a777c-6454686bbb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6a777c-6454686bbb-bqxvg
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6a777c-6454686bbb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6a777c-6454686bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6a777c: serviceaccount "payload-processing-e2e-ipp-b-6a777c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-q4pvt

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a777c-6454686bbb-bqxvg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-q4pvt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-q4pvt

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-6a777c-6454686bbb-bqxvg

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-q4pvt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a777c-6454686bbb-bqxvg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-q4pvt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a777c-6454686bbb-bqxvg

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6a777c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6a777c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-58cdc8-8c8857759-sd87n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-58cdc8-697cf6d99d-hhg4z

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

Unhealthy

Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

ProbeError

Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-71b161-668476b448-8489m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-71b161-575fcb688c-wdcgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-58cdc8-openshift-default-846ddb74d5-9t69m

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-71b161-openshift-default-59949694fc-x4c8d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-eb9d23-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-eb9d23-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-eb9d23-59d8b54bc9-2kfrx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-eb9d23-59f4b7d89b-wpphh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-05f827-58cdf7cf99-bbdgh

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-05f827-68c47d899d-2zzk5

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-05f827-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-05f827-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-05f827-openshift-default-6589fdcf57-5sncp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-448a3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-448a3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f5508-676f7884ff-wdjwj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f5508-69d86d8b84-nvfm6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-eb9d23-openshift-default-76b8d78d5c-ch5l7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-448a3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-448a3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-3f5508-openshift-default-547b8d6877-qxlzf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a777c-69c6c8467-q4pvt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a777c-6454686bbb-bqxvg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-6a777c-openshift-default-597bb4b5dc-v6p4v

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-86eaa9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-86eaa9

openshift-ingress

deployment-controller

e2e-praxis-a-86eaa9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-86eaa9-openshift-default-558749b8bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-86eaa9-openshift-default-558749b8bf

SuccessfulCreate

Created pod: e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

openshift-ingress

multus

e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-mg98p

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulCreate

Created pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 2 to 3
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-86eaa9: serviceaccount "payload-processing-e2e-praxis-a-86eaa9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-86eaa9-55b6679964

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-86eaa9-55b6679964-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-86eaa9: serviceaccount "payload-processing-e2e-praxis-a-86eaa9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-86eaa9-55b6679964

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-86eaa9-55b6679964-m8kkt

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-86eaa9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-86eaa9-55b6679964 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-86eaa9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-86eaa9-55b6679964-m8kkt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-mg98p

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-86eaa9-55b6679964-m8kkt

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-mg98p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-mg98p

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-86eaa9-55b6679964-m8kkt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-86eaa9-55b6679964-m8kkt

Started

Container started

openshift-ingress

multus

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-mg98p

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-lll9m

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-q4qrg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-czkn2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-q4qrg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-lll9m

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

Unhealthy

Startup probe failed: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

ProbeError

Startup probe error: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulCreate

Created pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulCreate

Created pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

Unhealthy

Startup probe failed: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

ProbeError

Startup probe error: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 3 to 5

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

Created

Container created

openshift-ingress

multus

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f7a36d-79d85f95f-qtvjt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f7a36d-5c4df657fb-p5srb

Unhealthy

Readiness probe failed: dial tcp 10.133.0.134:9004: i/o timeout

openshift-ingress

replicaset-controller

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f

SuccessfulCreate

Created pod: e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-2696d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-2696d8

openshift-ingress

deployment-controller

e2e-praxis-b-2696d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused

openshift-ingress

multus

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f7a36d-openshift-default-5756486b57-pgrdm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-2696d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2696d8: serviceaccount "payload-processing-e2e-praxis-b-2696d8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-tssf6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2696d8-6b6c64c76

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-2696d8-6b6c64c76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2696d8: serviceaccount "payload-processing-e2e-praxis-b-2696d8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2696d8-6b6c64c76

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-2696d8-6b6c64c76-hfq5h

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-2696d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-2696d8-6b6c64c76 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-tssf6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-tssf6

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2696d8-6b6c64c76-hfq5h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2696d8-6b6c64c76-hfq5h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-2696d8-6b6c64c76-hfq5h

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2696d8-6b6c64c76-hfq5h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-tssf6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-tssf6

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

ProbeError

Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

Unhealthy

Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-86eaa9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-153a44-969747556-xr6ct

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-86eaa9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbabed-865cf4767-v4c6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbabed-7cf5655f64-d72mz

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2696d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2696d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-86eaa9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-86eaa9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-dbabed-openshift-default-7cddf558b9-4n99s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-153a44-openshift-default-57c49f9997-jxwzp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-448a3a-f449fbb48-cdqxg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-448a3a-559597875-cxb2w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-153a44-7d899665f9-zl5ll

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-153a44-969747556-xr6ct

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

ProbeError

Readiness probe error: Get "http://10.133.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

Unhealthy

Readiness probe failed: Get "http://10.133.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-86eaa9-55b6679964-m8kkt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-86eaa9-df9d9767-mg98p

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-448a3a-openshift-default-6cc5f9c945-7l8zx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-86eaa9-openshift-default-558749b8bf-nq55x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2696d8-5f8657f5bc-tssf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2696d8-6b6c64c76-hfq5h

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2696d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2696d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-a2f984-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a2f984-openshift-default-c678cb5cc from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a2f984-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-a2f984-openshift-default-c678cb5cc

SuccessfulCreate

Created pod: e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

openshift-ingress

multus

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-2696d8-openshift-default-6c5d78dd6f-t64mt

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

ProbeError

Startup probe error: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

Unhealthy

Startup probe failed: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78gqk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

Created

Container created
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 4 to 5

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulCreate

Created pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

ProbeError

Startup probe error: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

Unhealthy

Startup probe failed: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-svdg4

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-sw4ms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j24vr

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-j24vr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-5jxq4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 2 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-swk8w

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-d4g28

openshift-ingress

deployment-controller

e2e-shared-a-w2-fcd6a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75

SuccessfulCreate

Created pod: e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-fcd6a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-fcd6a6

openshift-ingress

multus

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-447h2
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fcd6a6: serviceaccount "payload-processing-e2e-shared-a-w2-fcd6a6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-fcd6a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-fcd6a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 3 to 2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fcd6a6: serviceaccount "payload-processing-e2e-shared-a-w2-fcd6a6" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-skkgt

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65

SuccessfulCreate

Created pod: e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-9sbtk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 4 to 2

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-fjhhd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-e070ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-e070ea

openshift-ingress

deployment-controller

e2e-shared-a-w3-e070ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-66217b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-66217b

openshift-ingress

replicaset-controller

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf

SuccessfulCreate

Created pod: e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

openshift-ingress

multus

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-66217b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-66217b-openshift-default-7666bc75bf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-e070ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e070ea-b75f674b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-e070ea-b75f674b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e070ea: serviceaccount "payload-processing-e2e-shared-a-w3-e070ea" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e070ea-b75f674b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e070ea: serviceaccount "payload-processing-e2e-shared-a-w3-e070ea" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-e070ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-e070ea-b75f674b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9

SuccessfulCreate

Created pod: e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-e6b837

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-e6b837

openshift-ingress

deployment-controller

e2e-shared-a-w0-e6b837-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-66217b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-66217b-75f799bf98

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-66217b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-66217b-75f799bf98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-66217b: serviceaccount "payload-processing-e2e-shared-b-w2-66217b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-66217b-75f799bf98

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-66217b-75f799bf98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-66217b: serviceaccount "payload-processing-e2e-shared-b-w2-66217b" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-e6b837: serviceaccount "payload-processing-e2e-shared-a-w0-e6b837" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-e6b837: serviceaccount "payload-processing-e2e-shared-a-w0-e6b837" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-e6b837

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-e6b837

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-987vr

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-987vr
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fcd6a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fcd6a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-495ebe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-495ebe
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w3-495ebe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-495ebe-openshift-default-5f966f7587 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587

SuccessfulCreate

Created pod: e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

ProbeError

Startup probe error: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-495ebe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-495ebe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e070ea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-495ebe: serviceaccount "payload-processing-e2e-shared-b-w3-495ebe" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-495ebe: serviceaccount "payload-processing-e2e-shared-b-w3-495ebe" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e070ea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

Unhealthy

Startup probe failed: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

Unhealthy

Readiness probe failed: Get "http://10.134.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

ProbeError

Readiness probe error: Get "http://10.134.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e6b837-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e6b837-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w0-247158-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-247158-openshift-default-7d589d7779 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-247158

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-247158

openshift-ingress

replicaset-controller

e2e-shared-b-w0-247158-openshift-default-7d589d7779

SuccessfulCreate

Created pod: e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

openshift-ingress

multus

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8gd4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-a2f984-openshift-default-c678cb5cc

SuccessfulDelete

Deleted pod: e2e-worker-w4-a2f984-openshift-default-c678cb5cc-9nshc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a2f984-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-a2f984-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-a2f984-openshift-default-c678cb5cc from 2 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

ProbeError

Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

Unhealthy

Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-247158: serviceaccount "payload-processing-e2e-shared-b-w0-247158" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-247158

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj

openshift-ingress

replicaset-controller

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-247158

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-247158-7c8957d7bd from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-36bbac-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-36bbac-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf from 2 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-247158: serviceaccount "payload-processing-e2e-shared-b-w0-247158" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-2p6tq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75

SuccessfulCreate

Created pod: e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fcd6a6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w2-fcd6a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75 from 1 to 2

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

Created

Container created

openshift-ingress

multus

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

Unhealthy

Startup probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

ProbeError

Startup probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-cnj29

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e070ea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e070ea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-66217b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-66217b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565

SuccessfulCreate

Created pod: e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

openshift-ingress

deployment-controller

e2e-shared-a-w4-4c2415-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-4c2415

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-4c2415

openshift-ingress

multus

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e6b837-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e6b837-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-495ebe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-495ebe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-4c2415: serviceaccount "payload-processing-e2e-shared-a-w4-4c2415" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-4c2415

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-4c2415: serviceaccount "payload-processing-e2e-shared-a-w4-4c2415" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-4c2415

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

Unhealthy

Readiness probe failed: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

ProbeError

Readiness probe error: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

ProbeError

Startup probe error: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

Unhealthy

Startup probe failed: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-explicit-20a650

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-20a650

openshift-ingress

replicaset-controller

e2e-explicit-20a650-openshift-default-54678c495c

SuccessfulCreate

Created pod: e2e-explicit-20a650-openshift-default-54678c495c-j52w6

openshift-ingress

deployment-controller

e2e-explicit-20a650-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-20a650-openshift-default-54678c495c from 0 to 1

openshift-ingress

multus

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulDelete

Deleted pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-rkxkl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulDelete

Deleted pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-6cb89

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-247158-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 5 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-247158-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-20a650

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-20a650-7f7568947d from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-495ebe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-20a650-775687f6b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-20a650-7f7568947d

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-20a650-7f7568947d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-20a650: serviceaccount "payload-processing-e2e-explicit-20a650" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-20a650

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-20a650-775687f6b7 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-495ebe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-20a650-7f7568947d

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-20a650-7f7568947d-v6f87
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-20a650-775687f6b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-20a650-775687f6b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-20a650: serviceaccount "payload-processing-e2e-explicit-20a650" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-20a650-7f7568947d-v6f87

Started

Container started

openshift-ingress

multus

payload-processing-e2e-explicit-20a650-7f7568947d-v6f87

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-20a650-7f7568947d-v6f87

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-20a650-7f7568947d-v6f87

Created

Container created

openshift-ingress

multus

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4c2415-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565

SuccessfulCreate

Created pod: e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w4-4c2415-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565 from 1 to 2

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-247158-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-247158-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

Unhealthy

Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

ProbeError

Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w4-bbce72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-bbce72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-bbce72

openshift-ingress

replicaset-controller

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447

SuccessfulCreate

Created pod: e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

openshift-ingress

multus

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4c2415-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4c2415-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-bbce72: serviceaccount "payload-processing-e2e-shared-b-w4-bbce72" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-bbce72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-bbce72: serviceaccount "payload-processing-e2e-shared-b-w4-bbce72" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-bbce72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4c2415-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4c2415-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w3-495ebe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-495ebe-openshift-default-5f966f7587 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-495ebe-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587

SuccessfulCreate

Created pod: e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

Unhealthy

Startup probe failed: Get "http://10.133.0.192:15021/healthz/ready": dial tcp 10.133.0.192:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

ProbeError

Startup probe error: Get "http://10.133.0.192:15021/healthz/ready": dial tcp 10.133.0.192:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

ProbeError

Readiness probe error: Get "http://10.133.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

Unhealthy

Readiness probe failed: Get "http://10.133.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

Unhealthy

Startup probe failed: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

ProbeError

Startup probe error: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-20a650-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-20a650-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-20a650-7f7568947d-v6f87

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-bbce72-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-bbce72-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20a650-775687f6b7-r68v4

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.133:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-bbce72-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-bbce72-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-explicit-20a650-openshift-default-54678c495c-j52w6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-ea1940-openshift-default-698c8f66c7

SuccessfulCreate

Created pod: e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

openshift-ingress

deployment-controller

e2e-noten-ea1940-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ea1940-openshift-default-698c8f66c7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-ea1940

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ea1940

openshift-ingress

multus

e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

Started

Container started

openshift-ingress

kubelet

e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

Created

Container created

openshift-ingress

kubelet

e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-wsnwz

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-11258-0a4c2a

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11258-0a4c2a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11258-0a4c2a

Created

Container created

opendatahub

kubelet

test-curl-11258-0a4c2a

Started

Container started

opendatahub

kubelet

test-curl-11258-39b691

Created

Container created

opendatahub

kubelet

test-curl-11258-0a4c2a

Killing

Stopping container test-curl-11258-0a4c2a

opendatahub

multus

test-curl-11258-39b691

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11258-39b691

Started

Container started

opendatahub

kubelet

test-curl-11258-39b691

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11258-b9778e

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11258-b9778e

Started

Container started

opendatahub

kubelet

test-curl-11258-b9778e

Created

Container created

opendatahub

kubelet

test-curl-11258-b9778e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11258-39b691

Killing

Stopping container test-curl-11258-39b691

opendatahub

kubelet

test-curl-11258-0cd42e

Started

Container started

opendatahub

multus

test-curl-11258-0cd42e

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11258-b9778e

Killing

Stopping container test-curl-11258-b9778e

opendatahub

kubelet

test-curl-11258-0cd42e

Created

Container created

opendatahub

kubelet

test-curl-11258-0cd42e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-ea1940-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-ea1940-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-11258-bdc934

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11258-bdc934

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11258-bdc934

Created

Container created

opendatahub

kubelet

test-curl-11258-0cd42e

Killing

Stopping container test-curl-11258-0cd42e

opendatahub

kubelet

test-curl-11258-bdc934

Started

Container started

opendatahub

kubelet

test-curl-11258-bdc934

Killing

Stopping container test-curl-11258-bdc934

openshift-ingress

deployment-controller

e2e-extmod-a-ed8266-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7

SuccessfulCreate

Created pod: e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ed8266

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ed8266

openshift-ingress

multus

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ed8266: serviceaccount "payload-processing-e2e-extmod-a-ed8266" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-d6p8t

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ed8266-859f7dcc46

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ed8266-859f7dcc46-khc55

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ed8266

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ed8266-859f7dcc46

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ed8266-859f7dcc46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ed8266: serviceaccount "payload-processing-e2e-extmod-a-ed8266" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ed8266

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ed8266-859f7dcc46 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-d6p8t

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ed8266-859f7dcc46-khc55

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-ed8266-859f7dcc46-khc55

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ed8266-859f7dcc46-khc55

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ed8266-859f7dcc46-khc55

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-d6p8t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-d6p8t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-d6p8t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-ea1940-openshift-default-698c8f66c7-qjs9t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-11255-e26789

Started

Container started

opendatahub

kubelet

test-curl-11255-e26789

Created

Container created

opendatahub

kubelet

test-curl-11255-e26789

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11255-e26789

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11255-e26789

Killing

Stopping container test-curl-11255-e26789

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-6378cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6378cc

openshift-ingress

multus

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-6378cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6378cc-openshift-default-95b887bfc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-6378cc-openshift-default-95b887bfc

SuccessfulCreate

Created pod: e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-483bea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-483bea

openshift-ingress

replicaset-controller

e2e-extmod-b-483bea-openshift-default-58749c6765

SuccessfulCreate

Created pod: e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

openshift-ingress

multus

e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-483bea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-483bea-openshift-default-58749c6765 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulDelete

Deleted pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-59rmq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 3 to 2
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6378cc-69488d7976

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-6378cc-69488d7976-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6378cc: serviceaccount "payload-processing-e2e-extmod-a-6378cc" not found

openshift-ingress

deployment-controller

e2e-extmod-a-05bee8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-05bee8-openshift-default-7878c584df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6378cc-69488d7976

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h

openshift-ingress

multus

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-05bee8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-05bee8

openshift-ingress

replicaset-controller

e2e-extmod-a-05bee8-openshift-default-7878c584df

SuccessfulCreate

Created pod: e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-6378cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-6378cc-69488d7976 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-6378cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-6378cc-75c547648c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6378cc: serviceaccount "payload-processing-e2e-extmod-a-6378cc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-483bea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-483bea-64db95b77f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-483bea: serviceaccount "payload-processing-e2e-extmod-b-483bea" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-483bea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-483bea-585b8c58dd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-483bea-585b8c58dd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-483bea-585b8c58dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-483bea: serviceaccount "payload-processing-e2e-extmod-b-483bea" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-483bea-585b8c58dd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

Unhealthy

Readiness probe failed: Get "http://10.134.0.139:15021/healthz/ready": read tcp 10.134.0.2:60262->10.134.0.139:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

ProbeError

Readiness probe error: Get "http://10.134.0.139:15021/healthz/ready": read tcp 10.134.0.2:60262->10.134.0.139:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-c0e964

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-c0e964

openshift-ingress

deployment-controller

e2e-extmod-a-c0e964-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c0e964-openshift-default-555bff54df from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-c0e964-openshift-default-555bff54df

SuccessfulCreate

Created pod: e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-05bee8: serviceaccount "payload-processing-e2e-extmod-a-05bee8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-05bee8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-05bee8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb

openshift-ingress

multus

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-05bee8: serviceaccount "payload-processing-e2e-extmod-a-05bee8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-c0e964

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-c0e964

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-c0e964-7458d5f998 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c0e964: serviceaccount "payload-processing-e2e-extmod-a-c0e964" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c0e964-7458d5f998

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-c0e964-7458d5f998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c0e964: serviceaccount "payload-processing-e2e-extmod-a-c0e964" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c0e964-7458d5f998

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w0-247158-openshift-default-7d589d7779

SuccessfulCreate

Created pod: e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ed8266-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ed8266-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0e964-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0e964-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

ProbeError

Readiness probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

Unhealthy

Readiness probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

ProbeError

Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

Unhealthy

Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

Unhealthy

Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

ProbeError

Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-503804

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-503804

openshift-ingress

replicaset-controller

e2e-extmod-b-503804-openshift-default-5799fcdf7

SuccessfulCreate

Created pod: e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

openshift-ingress

deployment-controller

e2e-extmod-b-503804-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-503804-openshift-default-5799fcdf7 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6378cc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6378cc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-b195d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-b195d0
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-483bea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-483bea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-b195d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b195d0-openshift-default-6647b697d5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-503804

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-503804-8d5f44cf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-503804-8d5f44cf4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2

openshift-ingress

multus

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-503804

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-503804-6558f98787 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-503804-6558f98787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-503804-6558f98787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-503804-6558f98787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-503804: serviceaccount "payload-processing-e2e-extmod-b-503804" not found

openshift-ingress

replicaset-controller

e2e-extmod-b-b195d0-openshift-default-6647b697d5

SuccessfulCreate

Created pod: e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-503804-8d5f44cf4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-503804-8d5f44cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-503804: serviceaccount "payload-processing-e2e-extmod-b-503804" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-05bee8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-05bee8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-11264-6669e7

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11264-6669e7

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11264-6669e7

Created

Container created

opendatahub

kubelet

test-curl-11264-6669e7

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b195d0: serviceaccount "payload-processing-e2e-extmod-b-b195d0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b195d0-7475f7cb44

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-b195d0-7475f7cb44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b195d0: serviceaccount "payload-processing-e2e-extmod-b-b195d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-b195d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-b195d0-7475f7cb44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-b195d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b195d0-7475f7cb44

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11264-6669e7

Killing

Stopping container test-curl-11264-6669e7

openshift-ingress

deployment-controller

e2e-extmod-b-91705f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-91705f-openshift-default-7659df5f6f from 0 to 1

openshift-ingress

multus

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-91705f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-91705f

openshift-ingress

replicaset-controller

e2e-extmod-b-91705f-openshift-default-7659df5f6f

SuccessfulCreate

Created pod: e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

Unhealthy

Readiness probe failed: Get "http://10.134.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

ProbeError

Readiness probe error: Get "http://10.134.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6378cc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6378cc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-483bea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-483bea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-91705f: serviceaccount "payload-processing-e2e-extmod-b-91705f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-91705f-f6f6f96c8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-91705f-f6f6f96c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-91705f: serviceaccount "payload-processing-e2e-extmod-b-91705f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-91705f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-91705f-f6f6f96c8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-91705f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-91705f-f6f6f96c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

ProbeError

Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-05bee8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

Unhealthy

Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-05bee8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0e964-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0e964-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91705f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-autores-721c85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-721c85

openshift-ingress

replicaset-controller

e2e-autores-721c85-openshift-default-7dfccc8995

SuccessfulCreate

Created pod: e2e-autores-721c85-openshift-default-7dfccc8995-fz988

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91705f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-autores-721c85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-721c85-openshift-default-7dfccc8995 from 0 to 1

openshift-ingress

multus

e2e-autores-721c85-openshift-default-7dfccc8995-fz988

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-721c85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-721c85-76b87c7df5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-721c85-7fb8654d7b

SuccessfulCreate

Created pod: payload-processing-e2e-autores-721c85-7fb8654d7b-tjrcq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-721c85-76b87c7df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-721c85-76b87c7df5-kl8rr

openshift-ingress

deployment-controller

payload-processing-e2e-autores-721c85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-721c85-7fb8654d7b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-721c85-7fb8654d7b

FailedCreate

Error creating: pods "payload-processing-e2e-autores-721c85-7fb8654d7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-721c85: serviceaccount "payload-processing-e2e-autores-721c85" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-721c85-76b87c7df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-721c85-76b87c7df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-721c85: serviceaccount "payload-processing-e2e-autores-721c85" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-721c85-76b87c7df5-kl8rr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-721c85-7fb8654d7b-tjrcq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-721c85-76b87c7df5-kl8rr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-721c85-76b87c7df5-kl8rr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-721c85-7fb8654d7b-tjrcq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-autores-721c85-76b87c7df5-kl8rr

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-721c85-7fb8654d7b-tjrcq

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-721c85-7fb8654d7b-tjrcq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

ProbeError

Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

Unhealthy

Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-503804-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-503804-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

ProbeError

Readiness probe error: Get "http://10.134.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

Unhealthy

Readiness probe failed: Get "http://10.134.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-503804-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-503804-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

Unhealthy

Startup probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

ProbeError

Startup probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-fz988

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-fz988

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-fz988

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-721c85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-721c85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-fz988

ProbeError

Startup probe error: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-fz988

Unhealthy

Startup probe failed: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b195d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b195d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91705f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-721c85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-721c85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91705f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-autores-721c85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-721c85-openshift-default-7dfccc8995 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-721c85-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-autores-721c85-openshift-default-7dfccc8995

SuccessfulCreate

Created pod: e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

openshift-ingress

multus

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

Created

Container created

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

ProbeError

Startup probe error: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

Unhealthy

Startup probe failed: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-91705f-openshift-default-7659df5f6f

SuccessfulCreate

Created pod: e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

openshift-ingress

deployment-controller

e2e-extmod-b-91705f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-91705f-openshift-default-7659df5f6f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91705f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-b195d0-openshift-default-6647b697d5

SuccessfulCreate

Created pod: e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b195d0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-b195d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b195d0-openshift-default-6647b697d5 from 1 to 2

openshift-ingress

multus

e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-721c85-76b87c7df5-kl8rr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-721c85-7fb8654d7b-tjrcq

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

ProbeError

Startup probe error: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

Unhealthy

Startup probe failed: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-fz988

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-721c85-openshift-default-7dfccc8995-f54hz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-extmod-a-c0d6e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-c0d6e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-c0d6e7

openshift-ingress

replicaset-controller

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549

SuccessfulCreate

Created pod: e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

openshift-ingress

multus

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-b9hb8
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9hb8

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9hb8

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9hb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-b9hb8

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-c0d6e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9hb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9hb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c0d6e7: serviceaccount "payload-processing-e2e-extmod-a-c0d6e7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-4vrnx

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-v55ff

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-v55ff

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-v55ff

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-v55ff

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c0d6e7: serviceaccount "payload-processing-e2e-extmod-a-c0d6e7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-v55ff

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-c0d6e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-4vrnx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-4vrnx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-4vrnx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-4vrnx

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

Unhealthy

Startup probe failed: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

ProbeError

Startup probe error: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0d6e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0d6e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-fcf42a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-fcf42a

openshift-ingress

deployment-controller

e2e-extmod-b-fcf42a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fcf42a-openshift-default-774494965 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-fcf42a-openshift-default-774494965

SuccessfulCreate

Created pod: e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

openshift-ingress

multus

e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0d6e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0d6e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-fcf42a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-fcf42a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-fcf42a-7b6b696d58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-9q274

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-vqwgv

openshift-ingress

replicaset-controller

e2e-extmod-a-c0e964-openshift-default-555bff54df

SuccessfulCreate

Created pod: e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

openshift-ingress

multus

payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-9q274

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0e964-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fcf42a: serviceaccount "payload-processing-e2e-extmod-b-fcf42a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fcf42a-7b6b696d58

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-9q274
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fcf42a-7b6b696d58

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fcf42a: serviceaccount "payload-processing-e2e-extmod-b-fcf42a" not found

openshift-ingress

deployment-controller

e2e-extmod-a-c0e964-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c0e964-openshift-default-555bff54df from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-9q274

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-vqwgv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-vqwgv

Started

Container started

openshift-ingress

multus

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-vqwgv

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-9q274

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-vqwgv

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

Unhealthy

Startup probe failed: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

ProbeError

Startup probe error: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused body:
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-56fd9d7c8c

FailedCreate

Error creating: pods "payload-processing-external-model-56fd9d7c8c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-56fd9d7c8c from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-56fd9d7c8c-bjhwk

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-56fd9d7c8c-bjhwk

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-56fd9d7c8c

SuccessfulCreate

Created pod: payload-processing-external-model-56fd9d7c8c-bjhwk

models-as-a-service

kubelet

payload-processing-external-model-56fd9d7c8c-bjhwk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-56fd9d7c8c-bjhwk

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78prl

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78prl

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-56fd9d7c8c-bjhwk

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5f8949bcc5 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5f8949bcc5

FailedCreate

Error creating: pods "payload-processing-external-model-5f8949bcc5-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5f8949bcc5

SuccessfulCreate

Created pod: payload-processing-external-model-5f8949bcc5-q9m9b

models-as-a-service

kubelet

payload-processing-external-model-669d69b768-tlqsf

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5f8949bcc5-q9m9b

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5f8949bcc5-q9m9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5f8949bcc5-q9m9b

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5f8949bcc5-q9m9b

Started

Container started

models-as-a-service

multus

payload-processing-external-model-669d69b768-tlqsf

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-669d69b768-tlqsf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-669d69b768 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-669d69b768-tlqsf

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-669d69b768

SuccessfulCreate

Created pod: payload-processing-external-model-669d69b768-tlqsf

models-as-a-service

replicaset-controller

payload-processing-external-model-6db5744bf9

SuccessfulCreate

Created pod: payload-processing-external-model-6db5744bf9-qv2bf

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6db5744bf9 from 0 to 1

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5f8949bcc5 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5f8949bcc5

SuccessfulDelete

Deleted pod: payload-processing-external-model-5f8949bcc5-q9m9b

models-as-a-service

kubelet

payload-processing-external-model-5f8949bcc5-q9m9b

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6db5744bf9-qv2bf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6db5744bf9-qv2bf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6db5744bf9-qv2bf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6db5744bf9-qv2bf

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 2 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-rr9m8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-v45ts
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-rr9m8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-v45ts

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-rr9m8

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-rr9m8

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-v45ts

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-v45ts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-v45ts

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-rr9m8

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-669d69b768-tlqsf

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6db5744bf9-qv2bf

Killing

Stopping container payload-processing
(x4)

models-as-a-service

kubelet

payload-processing-external-model-669d69b768-tlqsf

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-3ad88dd1d8f2" not found, secret "agc-cred-3befd60c1db0" not found]

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65

SuccessfulCreate

Created pod: e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

openshift-ingress

deployment-controller

e2e-shared-a-w3-e070ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e070ea-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

Created

Container created
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-rr9m8

ProbeError

Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-rr9m8

Unhealthy

Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

Started

Container started
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-v45ts

Unhealthy

Startup probe failed: Get "http://10.133.0.218:15021/healthz/ready": dial tcp 10.133.0.218:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-v45ts

ProbeError

Startup probe error: Get "http://10.133.0.218:15021/healthz/ready": dial tcp 10.133.0.218:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-v45ts

ProbeError

Startup probe error: Get "http://10.133.0.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-v45ts

Unhealthy

Startup probe failed: Get "http://10.133.0.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

ProbeError

Startup probe error: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

Unhealthy

Startup probe failed: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-27xg6

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-gl57g

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gl57g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-79qpn

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-79qpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gl57g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gl57g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-27xg6

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-27xg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-27xg6

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-79qpn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-79qpn

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-ed8266-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7

SuccessfulCreate

Created pod: e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ed8266-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

Started

Container started
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-27xg6

Unhealthy

Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-27xg6

ProbeError

Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gl57g

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gl57g

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

ProbeError

Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

Unhealthy

Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-79qpn

ProbeError

Startup probe error: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

Unhealthy

Startup probe failed: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

ProbeError

Startup probe error: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-79qpn

Unhealthy

Startup probe failed: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-a-5f1508

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-5f1508

openshift-ingress

deployment-controller

e2e-inf-a-5f1508-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5f1508-openshift-default-6669f97b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-5f1508-openshift-default-6669f97b5

SuccessfulCreate

Created pod: e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

openshift-ingress

multus

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulCreate

Created pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

Started

Container started

openshift-ingress

multus

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

ProbeError

Startup probe error: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

Unhealthy

Startup probe failed: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-5f1508

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5f1508: serviceaccount "payload-processing-e2e-inf-a-5f1508" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5f1508-768b74fdc4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-5f1508-768b74fdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5f1508: serviceaccount "payload-processing-e2e-inf-a-5f1508" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5f1508-768b74fdc4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-5f1508

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-5f1508-768b74fdc4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fcf42a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fcf42a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-inf-a-134dad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-134dad-openshift-default-7d94b74d4f from 0 to 1

openshift-ingress

multus

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

AddedInterface

Add eth0 [10.133.0.223/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-134dad-openshift-default-7d94b74d4f

SuccessfulCreate

Created pod: e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

openshift-ingress

gateway_labeler_controller

e2e-inf-a-134dad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-134dad
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-134dad: serviceaccount "payload-processing-e2e-inf-a-134dad" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-134dad-6c4f8498cd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-134dad-6c4f8498cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-134dad: serviceaccount "payload-processing-e2e-inf-a-134dad" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-134dad-6c4f8498cd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-134dad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-134dad-6c4f8498cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-134dad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw

openshift-ingress

multus

payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fcf42a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fcf42a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f1508-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f1508-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

Unhealthy

Startup probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

ProbeError

Startup probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c

SuccessfulCreate

Created pod: e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

openshift-ingress

deployment-controller

e2e-inf-b-f9cd17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f9cd17-openshift-default-58dbc45b7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f9cd17

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f9cd17

openshift-ingress

kubelet

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

Unhealthy

Readiness probe failed: Get "http://10.133.0.223:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

ProbeError

Readiness probe error: Get "http://10.133.0.223:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f9cd17

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f9cd17-85664cc555 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f9cd17: serviceaccount "payload-processing-e2e-inf-b-f9cd17" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f9cd17-755544d75d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f9cd17-755544d75d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f9cd17: serviceaccount "payload-processing-e2e-inf-b-f9cd17" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f9cd17

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f9cd17-755544d75d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f9cd17-755544d75d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f1508-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f1508-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

Unhealthy

Startup probe failed: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

ProbeError

Startup probe error: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-134dad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-134dad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-b-82bec5-openshift-default-f944cddf5

SuccessfulCreate

Created pod: e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

openshift-ingress

deployment-controller

e2e-inf-b-82bec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-82bec5-openshift-default-f944cddf5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-82bec5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-82bec5

openshift-ingress

multus

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-82bec5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-82bec5-6f859cdf68 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-82bec5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-82bec5-6896b4d959 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-82bec5: serviceaccount "payload-processing-e2e-inf-b-82bec5" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-82bec5-6f859cdf68

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-82bec5-6f859cdf68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-82bec5: serviceaccount "payload-processing-e2e-inf-b-82bec5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-82bec5-6f859cdf68

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m

openshift-ingress

multus

payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-134dad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-134dad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-a-449d83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-449d83

openshift-ingress

deployment-controller

e2e-inf-a-449d83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-449d83-openshift-default-67ccff74c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-449d83-openshift-default-67ccff74c5

SuccessfulCreate

Created pod: e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

openshift-ingress

multus

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

AddedInterface

Add eth0 [10.133.0.228/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-449d83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-449d83-58478f6975 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-449d83-6f7f8b8c6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-449d83-6f7f8b8c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-449d83: serviceaccount "payload-processing-e2e-inf-a-449d83" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-449d83-58478f6975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-449d83-58478f6975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-449d83-58478f6975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-449d83: serviceaccount "payload-processing-e2e-inf-a-449d83" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-449d83-6f7f8b8c6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-449d83-6f7f8b8c6-h7dc5

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-449d83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-449d83-6f7f8b8c6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449d83-6f7f8b8c6-h7dc5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449d83-6f7f8b8c6-h7dc5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449d83-6f7f8b8c6-h7dc5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-449d83-6f7f8b8c6-h7dc5

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f9cd17-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f9cd17-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f9cd17-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f9cd17-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-82bec5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-82bec5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-a-7700a7-openshift-default-dd98dcf55

SuccessfulCreate

Created pod: e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

openshift-ingress

multus

e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-7700a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7700a7

openshift-ingress

deployment-controller

e2e-inf-a-7700a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-7700a7-openshift-default-dd98dcf55 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

ProbeError

Startup probe error: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

Unhealthy

Startup probe failed: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7700a7-79d494ff4d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-7700a7-79d494ff4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7700a7: serviceaccount "payload-processing-e2e-inf-a-7700a7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7700a7-79d494ff4d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7700a7: serviceaccount "payload-processing-e2e-inf-a-7700a7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-7700a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-7700a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-7700a7-79d494ff4d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-82bec5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-82bec5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-a-9f158a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9f158a

openshift-ingress

deployment-controller

e2e-inf-a-9f158a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9f158a-openshift-default-794665b7cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-9f158a-openshift-default-794665b7cf

SuccessfulCreate

Created pod: e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

openshift-ingress

multus

e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

AddedInterface

Add eth0 [10.133.0.230/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-9f158a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-9f158a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-9f158a-bf66cb696 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fd27a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fd27a9

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9f158a-bf66cb696

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9f158a: serviceaccount "payload-processing-e2e-inf-a-9f158a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv

openshift-ingress

replicaset-controller

e2e-inf-a-5f1508-openshift-default-6669f97b5

SuccessfulCreate

Created pod: e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f1508-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-5f1508-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5f1508-openshift-default-6669f97b5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-b-fd27a9-openshift-default-587d56b58c

SuccessfulCreate

Created pod: e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

openshift-ingress

deployment-controller

e2e-inf-b-fd27a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fd27a9-openshift-default-587d56b58c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9f158a-bf66cb696

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-9f158a-bf66cb696-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9f158a: serviceaccount "payload-processing-e2e-inf-a-9f158a" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85

AddedInterface

Add eth0 [10.132.0.238/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fd27a9-5f8758bbd8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-bkggj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fd27a9-5f8758bbd8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fd27a9: serviceaccount "payload-processing-e2e-inf-b-fd27a9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fd27a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fd27a9-5f8758bbd8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fd27a9: serviceaccount "payload-processing-e2e-inf-b-fd27a9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fd27a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fd27a9-549448bc99 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-bkggj

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-bkggj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-bkggj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-bkggj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

ProbeError

Startup probe error: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

Unhealthy

Startup probe failed: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-449d83-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-449d83-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

Unhealthy

Startup probe failed: Get "http://10.133.0.228:15021/healthz/ready": dial tcp 10.133.0.228:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

ProbeError

Startup probe error: Get "http://10.133.0.228:15021/healthz/ready": dial tcp 10.133.0.228:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-449d83-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-449d83-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

Unhealthy

Startup probe failed: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-7700a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

ProbeError

Startup probe error: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-7700a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-rr9m8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-27xg6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-79qpn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 8 to 5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-27xg6

openshift-ingress

deployment-controller

e2e-inf-b-e592d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e592d7-openshift-default-6465bbfb69 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e592d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e592d7

openshift-ingress

replicaset-controller

e2e-inf-b-e592d7-openshift-default-6465bbfb69

SuccessfulCreate

Created pod: e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

openshift-ingress

multus

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-7700a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-7700a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e592d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e592d7-846f4f9454 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e592d7: serviceaccount "payload-processing-e2e-inf-b-e592d7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e592d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e592d7-799cf664d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e592d7-846f4f9454

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e592d7-846f4f9454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e592d7: serviceaccount "payload-processing-e2e-inf-b-e592d7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e592d7-846f4f9454

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e592d7-846f4f9454-glsqh

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e592d7-846f4f9454-glsqh

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e592d7-846f4f9454-glsqh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-e592d7-846f4f9454-glsqh

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e592d7-846f4f9454-glsqh

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

ProbeError

Readiness probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

Unhealthy

Readiness probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

ProbeError

Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

Unhealthy

Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

ProbeError

Startup probe error: Get "http://10.133.0.230:15021/healthz/ready": dial tcp 10.133.0.230:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9f158a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9f158a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

Unhealthy

Startup probe failed: Get "http://10.133.0.230:15021/healthz/ready": dial tcp 10.133.0.230:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-fd27a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-fd27a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-inf-b-26b72f-openshift-default-7b644d5555

SuccessfulCreate

Created pod: e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

openshift-ingress

deployment-controller

e2e-inf-b-26b72f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-26b72f-openshift-default-7b644d5555 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-26b72f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-26b72f

openshift-ingress

multus

e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9f158a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9f158a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-26b72f-8499db668d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-26b72f-8499db668d-zkxrm

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-26b72f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-26b72f-8499db668d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-26b72f-8499db668d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-26b72f-8499db668d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-26b72f: serviceaccount "payload-processing-e2e-inf-b-26b72f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-26b72f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-26b72f: serviceaccount "payload-processing-e2e-inf-b-26b72f" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9

AddedInterface

Add eth0 [10.133.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-26b72f-8499db668d-zkxrm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-26b72f-8499db668d-zkxrm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-26b72f-8499db668d-zkxrm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-26b72f-8499db668d-zkxrm

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-fd27a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-fd27a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e592d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e592d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e592d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e592d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-26b72f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-26b72f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

Unhealthy

Startup probe failed: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

ProbeError

Startup probe error: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-b-82bec5-openshift-default-f944cddf5

SuccessfulCreate

Created pod: e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-82bec5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-82bec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-82bec5-openshift-default-f944cddf5 from 1 to 2

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

AddedInterface

Add eth0 [10.133.0.247/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

Unhealthy

Startup probe failed: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

ProbeError

Startup probe error: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-26b72f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-26b72f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-b-91705f-openshift-default-7659df5f6f

SuccessfulDelete

Deleted pod: e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91705f-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-91705f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-91705f-openshift-default-7659df5f6f from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-wx9kc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4c2415-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w4-4c2415-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565 from 2 to 1

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w0-247158-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-247158-openshift-default-7d589d7779 from 2 to 1

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-wv7ss

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-b-w0-247158-openshift-default-7d589d7779

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-247158-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulDelete

Deleted pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-mb6fn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-m4jdn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-c0e964-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-c0e964-openshift-default-555bff54df from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-c0e964-openshift-default-555bff54df

SuccessfulDelete

Deleted pod: e2e-extmod-a-c0e964-openshift-default-555bff54df-lxzs4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c0e964-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b195d0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-b195d0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-b195d0-openshift-default-6647b697d5 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-b195d0-openshift-default-6647b697d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-b195d0-openshift-default-6647b697d5-7npbf
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-134dad-6c4f8498cd-w5bc5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-134dad-7bcdc5b659-djmlw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f1508-6bfd88d9f5-nvjqx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f1508-768b74fdc4-xpvnb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75

SuccessfulDelete

Deleted pod: e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-5d74b9-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-5d74b9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-5d74b9-openshift-default-c4dbcb75 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-f5n6d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-134dad-openshift-default-7d94b74d4f-psjdq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-inf-b-26b72f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-26b72f-openshift-default-7b644d5555 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-26b72f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

AddedInterface

Add eth0 [10.132.1.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-26b72f-openshift-default-7b644d5555

SuccessfulCreate

Created pod: e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fcd6a6-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w2-fcd6a6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75 from 2 to 1

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75

SuccessfulDelete

Deleted pod: e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729
(x5)

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

Unhealthy

Startup probe failed: Get "http://10.132.1.17:15021/healthz/ready": dial tcp 10.132.1.17:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

ProbeError

Startup probe error: Get "http://10.132.1.17:15021/healthz/ready": dial tcp 10.132.1.17:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-82bec5-6f859cdf68-8pb9m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-82bec5-6896b4d959-ssqtw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-54qmz

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-v45ts

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-z6729

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-v45ts
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-5f1508-openshift-default-6669f97b5-5dsb7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-495ebe-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-495ebe-openshift-default-5f966f7587 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-495ebe-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-ed8266-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ed8266-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7

SuccessfulDelete

Deleted pod: e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-gq7jb

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-p2bwd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f9cd17-85664cc555-9cgvt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f9cd17-755544d75d-459sc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-r74s7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-82bec5-openshift-default-f944cddf5-hxqf8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-f9cd17-openshift-default-58dbc45b7c-fhj75

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449d83-6f7f8b8c6-h7dc5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449d83-58478f6975-j7hc7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-wmnwp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-fh868

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gw78n

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-fh868

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-wmnwp

AddedInterface

Add eth0 [10.133.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-wmnwp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-fh868

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gw78n

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-wmnwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-fh868

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gw78n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-gw78n

AddedInterface

Add eth0 [10.133.0.249/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-fh868

ProbeError

Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-wmnwp

Unhealthy

Startup probe failed: Get "http://10.133.0.248:15021/healthz/ready": dial tcp 10.133.0.248:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-wmnwp

ProbeError

Startup probe error: Get "http://10.133.0.248:15021/healthz/ready": dial tcp 10.133.0.248:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gw78n

ProbeError

Startup probe error: Get "http://10.133.0.249:15021/healthz/ready": dial tcp 10.133.0.249:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gw78n

Unhealthy

Startup probe failed: Get "http://10.133.0.249:15021/healthz/ready": dial tcp 10.133.0.249:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-fh868

Unhealthy

Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gw78n

ProbeError

Startup probe error: Get "http://10.133.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gw78n

Unhealthy

Startup probe failed: Get "http://10.133.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-449d83-openshift-default-67ccff74c5-rnqwb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fd27a9-5f8758bbd8-bkggj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fd27a9-549448bc99-kdsxq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-fd27a9-openshift-default-587d56b58c-2gv7j

Killing

Stopping container istio-proxy

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-pghfc

AddedInterface

Add eth0 [10.132.1.23/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 8 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f694df8bc-pghfc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-vq58x

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-vq58x

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-pghfc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-vq58x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-vq58x

AddedInterface

Add eth0 [10.133.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-pghfc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-pghfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-vq58x

ProbeError

Startup probe error: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-vq58x

Unhealthy

Startup probe failed: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-pghfc

ProbeError

Startup probe error: Get "http://10.132.1.23:15021/healthz/ready": dial tcp 10.132.1.23:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-pghfc

Unhealthy

Startup probe failed: Get "http://10.132.1.23:15021/healthz/ready": dial tcp 10.132.1.23:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7700a7-8b65dd5ff-j66bf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7700a7-79d494ff4d-qvf45

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-7700a7-openshift-default-dd98dcf55-ns556

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e592d7-846f4f9454-glsqh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9f158a-bf66cb696-vpp85

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9f158a-87c6d57f5-bmdkv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e070ea-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-e070ea-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

Unhealthy

Readiness probe failed: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-prc2b

ProbeError

Readiness probe error: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e592d7-799cf664d7-gdr2v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-9f158a-openshift-default-794665b7cf-74d6f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-26b72f-8499db668d-zkxrm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-b5496290

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b5496290

openshift-ingress

deployment-controller

e2e-mt-b5496290-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b5496290-openshift-default-786dddd54f from 0 to 1

openshift-ingress

multus

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

AddedInterface

Add eth0 [10.133.0.251/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-b5496290-openshift-default-786dddd54f

SuccessfulCreate

Created pod: e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

openshift-ingress

kubelet

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

Unhealthy

Readiness probe failed: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-e592d7-openshift-default-6465bbfb69-gcvt6

ProbeError

Readiness probe error: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b5496290

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b5496290-c59bb6f6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b5496290

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b5496290-5dbd66898 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b5496290-5dbd66898

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b5496290-5dbd66898-zm9gw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b5496290-5dbd66898

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b5496290-5dbd66898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b5496290: serviceaccount "payload-processing-e2e-mt-b5496290" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b5496290-c59bb6f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b5496290: serviceaccount "payload-processing-e2e-mt-b5496290" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b5496290-c59bb6f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-w4dgt

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-w4dgt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-b5496290-5dbd66898-zm9gw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-w4dgt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-w4dgt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-w4dgt

AddedInterface

Add eth0 [10.132.1.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-b5496290-5dbd66898-zm9gw

AddedInterface

Add eth0 [10.132.1.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b5496290-5dbd66898-zm9gw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-26b72f-5d5bd5d9f-x42j9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-mt-b5496290-5dbd66898-zm9gw

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-b4708a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b4708a-openshift-default-f9f6fc547 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b4708a-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b4708a-openshift-default-f9f6fc547

SuccessfulDelete

Deleted pod: e2e-worker-w3-b4708a-openshift-default-f9f6fc547-m2l5q

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-j45zj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-26b72f-openshift-default-7b644d5555-d2ksm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-b9hb8

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9hb8

Killing

Stopping container discovery

openshift-ingress

kubelet

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

Unhealthy

Readiness probe failed: Get "http://10.133.0.251:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

ProbeError

Readiness probe error: Get "http://10.133.0.251:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-247158-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-shared-b-w0-247158-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-247158-openshift-default-7d589d7779 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w0-247158-openshift-default-7d589d7779

SuccessfulCreate

Created pod: e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

Started

Container started

openshift-ingress

multus

e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

AddedInterface

Add eth0 [10.132.1.33/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ed8266-859f7dcc46-khc55

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ed8266-5d94cc9fcf-d6p8t

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

Unhealthy

Startup probe failed: Get "http://10.132.1.33:15021/healthz/ready": dial tcp 10.132.1.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

ProbeError

Startup probe error: Get "http://10.132.1.33:15021/healthz/ready": dial tcp 10.132.1.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

ProbeError

Startup probe error: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

Unhealthy

Startup probe failed: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b5496290-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b5496290-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-ed8266-openshift-default-9c5b6fdc7-kgjxz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b5496290-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b5496290-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6378cc-69488d7976-q7h5h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6378cc-75c547648c-m7rxr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-483bea-585b8c58dd-zzv7q

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.135:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-483bea-64db95b77f-mprvh

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.134:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-extmod-a-6378cc-openshift-default-95b887bfc-rsrml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-483bea-openshift-default-58749c6765-brcvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-fcd6a6-openshift-default-7b9d84db75-7nr2p

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-503804-6558f98787-75dmx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-503804-8d5f44cf4-qfln2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-mt-b5496290-5dbd66898-zm9gw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b5496290-c59bb6f6c-w4dgt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd6a6-57b96fb768-gklpz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd6a6-759c684447-6hln2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-247158-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w0-247158-openshift-default-7d589d7779

SuccessfulCreate

Created pod: e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

openshift-ingress

deployment-controller

e2e-shared-b-w0-247158-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-247158-openshift-default-7d589d7779 from 2 to 3

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

Started

Container started

openshift-ingress

multus

e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-66217b-openshift-default-7666bc75bf-9j6d6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-66217b-dbbcd7959-7xv5t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-66217b-75f799bf98-6zt8f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

ProbeError

Startup probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

Unhealthy

Startup probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-a-w0-e6b837-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e6b837-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9

SuccessfulCreate

Created pod: e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

openshift-ingress

multus

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

AddedInterface

Add eth0 [10.132.1.40/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-b5496290-openshift-default-786dddd54f-tplpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-503804-openshift-default-5799fcdf7-2t2f9

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

Unhealthy

Startup probe failed: Get "http://10.132.1.40:15021/healthz/ready": dial tcp 10.132.1.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

ProbeError

Startup probe error: Get "http://10.132.1.40:15021/healthz/ready": dial tcp 10.132.1.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-5d74b9-58f7b8cdc9-5hvv7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-5d74b9-openshift-default-c4dbcb75-2vjfz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-5d74b9-58b6754b68-mb7rh

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.43:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6796b1-768bc96979-6s778

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6796b1-7b59f6c658-vgzs8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg

AddedInterface

Add eth0 [10.133.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-6796b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6796b1-openshift-default-56c9bb8b49 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6796b1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49

SuccessfulCreate

Created pod: e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg
(x3)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg

Unhealthy

Startup probe failed: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg

ProbeError

Startup probe error: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-df8pg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0d6e7-859b8d8c47-v55ff

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0d6e7-7f46967c8b-4vrnx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-6796b1-openshift-default-56c9bb8b49-76qzb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-c0d6e7-openshift-default-5d4d6c5549-sgwqm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fcf42a-7b6b696d58-9q274

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fcf42a-7f456f8d55-vqwgv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-fcf42a-openshift-default-774494965-7n2mf

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-11252-5d15eb

AddedInterface

Add eth0 [10.132.1.46/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11252-5d15eb

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11252-5d15eb

Created

Container created

opendatahub

kubelet

test-curl-11252-5d15eb

Started

Container started

opendatahub

kubelet

test-curl-11252-5d15eb

Killing

Stopping container test-curl-11252-5d15eb

opendatahub

multus

test-curl-11252-aef277

AddedInterface

Add eth0 [10.132.1.47/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11252-aef277

Created

Container created

opendatahub

kubelet

test-curl-11252-aef277

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11252-aef277

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-11252-aef277

Killing

Stopping container test-curl-11252-aef277
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4c2415-5d69f95ddc-sqdkd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4c2415-65fb5f487d-vvt6t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-4c2415-openshift-default-76f7cbd565-kwxxd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-bbce72-76dc8f68dd-wqx7f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-bbce72-64f9dd7dd7-n87x5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w4-bbce72-openshift-default-6bb7f5c447-dzvnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-78prl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-vq58x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 10 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-78prl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gw78n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-wmnwp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-c0e964-openshift-default-555bff54df-6q8tg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c0e964-7458d5f998-692gc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c0e964-d7d6c8c8c-xgsmh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a2f984-bd5b789d-ccv58

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a2f984-67c675d495-tpzx7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-05bee8-openshift-default-7878c584df-t84sw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91705f-f6f6f96c8-jq4lb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91705f-bd7b85d99-97w7n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-a2f984-openshift-default-c678cb5cc-gwt5r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-05bee8-5fd587974c-r47k6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-05bee8-7b8ffc66f8-tlzvb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-91705f-openshift-default-7659df5f6f-gtvbr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-b195d0-openshift-default-6647b697d5-twx2l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b195d0-c454c77b7-jmtxs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b195d0-7475f7cb44-wrgf4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-j2fj2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-e6b837-openshift-default-77d9944fd9-lm72h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e6b837-5b7557b97d-7wsdb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-e070ea-openshift-default-54d4b8cc65-mzpcs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e070ea-b75f674b-hr9p9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e070ea-f9c978495-ts7xx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e6b837-6f8d855b9f-xlfcz

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.124:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-4f6mv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-qjdwk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-247158-7b5588b64c-29z2t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-247158-7c8957d7bd-nvvnj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-247158-openshift-default-7d589d7779-ljdgh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-495ebe-openshift-default-5f966f7587-q447h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-495ebe-d9cdfd7ff-6fznl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-495ebe-85c64f49b4-n9h8m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-b4708a-openshift-default-f9f6fc547-z9b7w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-36bbac-openshift-default-6f9cf6c5cf-x6c5q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-36bbac-75df4744d4-k67rg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-36bbac-7479548695-5fp2q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b4708a-6c9475c6ff-pw7v5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b4708a-fbc8b564-qq4sj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-ait-a566022b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a566022b

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f694df8bc

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-pghfc
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-pghfc

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

AddedInterface

Add eth0 [10.133.1.4/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-a566022b-openshift-default-544fdb78c7

SuccessfulCreate

Created pod: e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

openshift-ingress

deployment-controller

e2e-ait-a566022b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a566022b-openshift-default-544fdb78c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a566022b-c898dff55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a566022b-c898dff55-t8pdb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a566022b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a566022b-c898dff55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a566022b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a566022b-5cd659b5bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a566022b-5cd659b5bb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a566022b-5cd659b5bb-7rzrg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a566022b-5cd659b5bb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a566022b-5cd659b5bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a566022b: serviceaccount "payload-processing-e2e-ait-a566022b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a566022b-c898dff55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a566022b-c898dff55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a566022b: serviceaccount "payload-processing-e2e-ait-a566022b" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-a566022b-5cd659b5bb-7rzrg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a566022b-c898dff55-t8pdb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a566022b-c898dff55-t8pdb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-a566022b-5cd659b5bb-7rzrg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-a566022b-5cd659b5bb-7rzrg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a566022b-c898dff55-t8pdb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-a566022b-c898dff55-t8pdb

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-a566022b-5cd659b5bb-7rzrg

AddedInterface

Add eth0 [10.133.1.6/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

ProbeError

Readiness probe error: Get "http://10.133.1.4:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

Unhealthy

Readiness probe failed: Get "http://10.133.1.4:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

kubelet

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

Unhealthy

Startup probe failed: Get "http://10.133.1.4:15021/healthz/ready": dial tcp 10.133.1.4:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

ProbeError

Startup probe error: Get "http://10.133.1.4:15021/healthz/ready": dial tcp 10.133.1.4:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a566022b-c898dff55-t8pdb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a566022b-5cd659b5bb-7rzrg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a566022b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a566022b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-a566022b-openshift-default-544fdb78c7-9jhgp

Killing

Stopping container istio-proxy

opendatahub

kubelet

maas-controller-6f4559f84c-tknlp

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-6f4559f84c

SuccessfulDelete

Deleted pod: maas-controller-6f4559f84c-tknlp

opendatahub

multus

maas-controller-6f4559f84c-cb6r5

AddedInterface

Add eth0 [10.133.1.7/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6f4559f84c-cb6r5

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:265e8f5f239e521a0d192c2629db6e2d85bea5ce812ae154b0a825cc5af46b66"

opendatahub

replicaset-controller

maas-controller-6f4559f84c

SuccessfulCreate

Created pod: maas-controller-6f4559f84c-cb6r5

opendatahub

kubelet

maas-controller-6f4559f84c-cb6r5

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:265e8f5f239e521a0d192c2629db6e2d85bea5ce812ae154b0a825cc5af46b66" in 1.846s (1.846s including waiting). Image size: 200057366 bytes.

opendatahub

kubelet

maas-controller-6f4559f84c-cb6r5

Created

Container created

opendatahub

kubelet

maas-controller-6f4559f84c-cb6r5

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 5 to 7

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-c99g8

AddedInterface

Add eth0 [10.133.1.9/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

AddedInterface

Add eth0 [10.133.1.8/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

Started

Container started

opendatahub

maas-controller-6f4559f84c-cb6r5_e748fe58-952f-4a9a-b4f6-2608de852fe6

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6f4559f84c-cb6r5_e748fe58-952f-4a9a-b4f6-2608de852fe6 became leader
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

ProbeError

Startup probe error: Get "http://10.133.1.8:15021/healthz/ready": dial tcp 10.133.1.8:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

ProbeError

Startup probe error: Get "http://10.133.1.9:15021/healthz/ready": dial tcp 10.133.1.9:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

Unhealthy

Startup probe failed: Get "http://10.133.1.9:15021/healthz/ready": dial tcp 10.133.1.9:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

Unhealthy

Startup probe failed: Get "http://10.133.1.8:15021/healthz/ready": dial tcp 10.133.1.8:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

ProbeError

Startup probe error: Get "http://10.133.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

Unhealthy

Startup probe failed: Get "http://10.133.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

Unhealthy

Startup probe failed: Get "http://10.133.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

ProbeError

Startup probe error: Get "http://10.133.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-6f4559f84c from 1 to 0

opendatahub

replicaset-controller

maas-controller-6f4559f84c

SuccessfulDelete

Deleted pod: maas-controller-6f4559f84c-cb6r5

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 7 to 9

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

opendatahub

kubelet

maas-controller-6f4559f84c-cb6r5

Killing

Stopping container manager

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-smfn4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-smfn4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-smfn4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

AddedInterface

Add eth0 [10.133.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-smfn4

AddedInterface

Add eth0 [10.132.1.58/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-6f4559f84c

SuccessfulCreate

Created pod: maas-controller-6f4559f84c-tdxj7

opendatahub

multus

maas-controller-6f4559f84c-tdxj7

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-6f4559f84c from 0 to 1

opendatahub

kubelet

maas-controller-6f4559f84c-tdxj7

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:265e8f5f239e521a0d192c2629db6e2d85bea5ce812ae154b0a825cc5af46b66"

opendatahub

kubelet

maas-controller-6f4559f84c-tdxj7

Started

Container started

opendatahub

kubelet

maas-controller-6f4559f84c-tdxj7

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:265e8f5f239e521a0d192c2629db6e2d85bea5ce812ae154b0a825cc5af46b66" in 1.392s (1.392s including waiting). Image size: 200057366 bytes.

opendatahub

kubelet

maas-controller-6f4559f84c-tdxj7

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

ProbeError

Startup probe error: Get "http://10.133.1.10:15021/healthz/ready": dial tcp 10.133.1.10:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

Unhealthy

Startup probe failed: Get "http://10.133.1.10:15021/healthz/ready": dial tcp 10.133.1.10:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-smfn4

Unhealthy

Startup probe failed: Get "http://10.132.1.58:15021/healthz/ready": dial tcp 10.132.1.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-smfn4

ProbeError

Startup probe error: Get "http://10.132.1.58:15021/healthz/ready": dial tcp 10.132.1.58:15021: connect: connection refused body:

opendatahub

maas-controller-6f4559f84c-tdxj7_6c198b48-476b-40d4-b35b-a9d22c09bf44

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6f4559f84c-tdxj7_6c198b48-476b-40d4-b35b-a9d22c09bf44 became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

Started

Container started
(x8)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 9 to 10
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

deployment-controller

e2e-prio-pool-14305626-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-14305626-kserve-57b87f7fcd from 0 to 1

llm

replicaset-controller

e2e-prio-pool-14305626-kserve-57b87f7fcd

SuccessfulCreate

Created pod: e2e-prio-pool-14305626-kserve-57b87f7fcd-7l77s

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.ServiceAccount llm/e2e-prio-pool-14305626-epp-sa

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.Service llm/e2e-prio-pool-14305626-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-14305626-epp-auth-rb

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.Deployment llm/e2e-prio-pool-14305626-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.Secret llm/e2e-prio-pool-14305626-kserve-self-signed-certs

llm

multus

e2e-prio-pool-14305626-kserve-57b87f7fcd-7l77s

AddedInterface

Add eth0 [10.133.1.15/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.Service llm/e2e-prio-pool-14305626-epp-service

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.Role llm/e2e-prio-pool-14305626-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.RoleBinding llm/e2e-prio-pool-14305626-epp-rb

llm

kubelet

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

multus

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

AddedInterface

Add eth0 [10.133.1.16/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

Created v1.Deployment llm/e2e-prio-pool-14305626-kserve-router-scheduler

llm

replicaset-controller

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf

SuccessfulCreate

Created pod: e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

llm

deployment-controller

e2e-prio-pool-14305626-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf from 0 to 1

llm

kubelet

e2e-prio-pool-14305626-kserve-57b87f7fcd-7l77s

Created

Container created

llm

kubelet

e2e-prio-pool-14305626-kserve-57b87f7fcd-7l77s

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-prio-pool-14305626-kserve-57b87f7fcd-7l77s

Started

Container started

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-14305626-kserve-route

llm

kubelet

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

Created

Container created
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-14305626-kserve-shadow-svc

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Updated

Updated v1.Secret llm/e2e-prio-pool-14305626-kserve-self-signed-certs

llm

kubelet

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 1.609s (1.609s including waiting). Image size: 184206420 bytes.

llm

kubelet

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

Started

Container started

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-14305626] is Ready

llm

LLMInferenceServiceController

e2e-prio-pool-14305626

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-14305626-epp-auth-rb

llm

kubelet

e2e-prio-pool-14305626-kserve-57b87f7fcd-7l77s

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

Killing

Stopping container main

openshift-ingress

replicaset-controller

e2e-worker-single-main-6949ad-openshift-default-698bf75589

SuccessfulCreate

Created pod: e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

openshift-ingress

multus

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-single-main-6949ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-6949ad-openshift-default-698bf75589 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-6949ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-6949ad

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-6949ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-6949ad-8558cd755 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-6949ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-6949ad-558767ff74 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-6949ad-8558cd755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-6949ad-8558cd755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-6949ad: serviceaccount "payload-processing-e2e-worker-single-main-6949ad" not found

openshift-ingress

multus

payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-6949ad-8558cd755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-6949ad-558767ff74

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-6949ad-558767ff74

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-6949ad-558767ff74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-6949ad: serviceaccount "payload-processing-e2e-worker-single-main-6949ad" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

ProbeError

Readiness probe error: Get "http://10.134.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

Unhealthy

Readiness probe failed: Get "http://10.134.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

ProbeError

Startup probe error: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

Unhealthy

Startup probe failed: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused
(x5)

llm

kubelet

e2e-prio-pool-14305626-kserve-router-scheduler-5b9d45dcbf-rfkzz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-6949ad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-6949ad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

Killing

Stopping container istio-proxy

llm

deployment-controller

e2e-same-id-a-d1402746-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-d1402746-kserve-76485f7849 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Created

Created v1.Secret llm/e2e-same-id-a-d1402746-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Created

Created v1.Deployment llm/e2e-same-id-a-d1402746-kserve

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-single-main-6949ad-openshift-default-698bf75589ngp7q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

llm

kubelet

e2e-same-id-a-d1402746-kserve-76485f7849-2kcbf

Created

Container created

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Created

Created v1.HTTPRoute llm/e2e-same-id-a-d1402746-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Created

Created v1.PodMonitor llm/e2e-same-id-a-d1402746-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Created

Created v1.PodMonitor llm/e2e-same-id-a-d1402746-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Created

Created v1.DestinationRule llm/e2e-same-id-a-d1402746-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Created

Created v1.Service llm/e2e-same-id-a-d1402746-kserve-workload-svc

llm

multus

e2e-same-id-a-d1402746-kserve-76485f7849-2kcbf

AddedInterface

Add eth0 [10.133.1.18/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-a-d1402746-kserve-76485f7849-2kcbf

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-a-d1402746-kserve-76485f7849-2kcbf

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-d1402746-prometheus-scraping

llm

replicaset-controller

e2e-same-id-a-d1402746-kserve-76485f7849

SuccessfulCreate

Created pod: e2e-same-id-a-d1402746-kserve-76485f7849-2kcbf
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-6949ad-8558cg88f7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-6949ad-558767ff7n6snk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

Updated

Updated v1.Secret llm/e2e-same-id-a-d1402746-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-d1402746] is Ready

llm

replicaset-controller

e2e-same-id-b-d1402746-kserve-6d7cddc457

SuccessfulCreate

Created pod: e2e-same-id-b-d1402746-kserve-6d7cddc457-kgq2k

llm

deployment-controller

e2e-same-id-b-d1402746-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-d1402746-kserve-6d7cddc457 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Created

Created v1.Secret llm/e2e-same-id-b-d1402746-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Created

Created v1.HTTPRoute llm/e2e-same-id-b-d1402746-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Created

Created v1.Deployment llm/e2e-same-id-b-d1402746-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Created

Created v1.Service llm/e2e-same-id-b-d1402746-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Created

Created v1.DestinationRule llm/e2e-same-id-b-d1402746-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Created

Created v1.PodMonitor llm/e2e-same-id-b-d1402746-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-d1402746-prometheus-scraping

llm

kubelet

e2e-same-id-b-d1402746-kserve-6d7cddc457-kgq2k

Started

Container started

llm

multus

e2e-same-id-b-d1402746-kserve-6d7cddc457-kgq2k

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-d1402746-kserve-6d7cddc457-kgq2k

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-b-d1402746-kserve-6d7cddc457-kgq2k

Created

Container created

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Created

Created v1.PodMonitor llm/e2e-same-id-b-d1402746-kserve-llmisvc-engine-default
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

Updated

Updated v1.Secret llm/e2e-same-id-b-d1402746-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-d1402746] is Ready
(x4)

llm

LLMInferenceServiceController

e2e-same-id-a-d1402746

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-d1402746 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-d1402746; safe to ignore if traffic splitting is planned
(x6)

llm

LLMInferenceServiceController

e2e-same-id-b-d1402746

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-d1402746 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-d1402746; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-d1402746-kserve-76485f7849-2kcbf

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-d1402746-kserve-6d7cddc457-kgq2k

Killing

Stopping container main
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-fh868

Unhealthy

Readiness probe failed: Get "http://10.134.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

ProbeError

Readiness probe error: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-x8mpd

Unhealthy

Readiness probe failed: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-fh868

ProbeError

Readiness probe error: Get "http://10.134.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-5c58448fd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-5c58448fd8

SuccessfulCreate

Created pod: payload-pre-processing-5c58448fd8-7pcq4

openshift-ingress

kubelet

payload-pre-processing-5c58448fd8-7pcq4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-5c58448fd8-7pcq4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-5c58448fd8-7pcq4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-5c58448fd8-7pcq4

AddedInterface

Add eth0 [10.133.1.19/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-v7lnv

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-v7lnv

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

kubelet

payload-processing-77bf598fff-7f6b5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-77bf598fff

SuccessfulCreate

Created pod: payload-processing-77bf598fff-7f6b5

openshift-ingress

kubelet

payload-processing-77bf598fff-7f6b5

Started

Container started

openshift-ingress

kubelet

payload-processing-77bf598fff-7f6b5

Created

Container created

openshift-ingress

multus

payload-processing-77bf598fff-7f6b5

AddedInterface

Add eth0 [10.133.1.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-77bf598fff from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-5f78687d5b from 1 to 0

openshift-ingress

kubelet

payload-processing-5f78687d5b-l4r5r

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulDelete

Deleted pod: payload-processing-5f78687d5b-l4r5r

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-58744ff6df from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5688bd49d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-58744ff6df

SuccessfulCreate

Created pod: payload-pre-processing-58744ff6df-48bdt

openshift-ingress

replicaset-controller

payload-processing-5688bd49d7

SuccessfulCreate

Created pod: payload-processing-5688bd49d7-w75hb

openshift-ingress

kubelet

payload-processing-5688bd49d7-w75hb

Started

Container started

openshift-ingress

kubelet

payload-processing-5688bd49d7-w75hb

Created

Container created

openshift-ingress

kubelet

payload-processing-5688bd49d7-w75hb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-5688bd49d7-w75hb

AddedInterface

Add eth0 [10.133.1.21/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-58744ff6df-48bdt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-58744ff6df-48bdt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-58744ff6df-48bdt

Created

Container created

openshift-ingress

multus

payload-pre-processing-58744ff6df-48bdt

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-5c58448fd8 from 1 to 0

openshift-ingress

replicaset-controller

payload-pre-processing-5c58448fd8

SuccessfulDelete

Deleted pod: payload-pre-processing-5c58448fd8-7pcq4

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-77bf598fff from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-5c58448fd8-7pcq4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-77bf598fff-7f6b5

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-77bf598fff

SuccessfulDelete

Deleted pod: payload-processing-77bf598fff-7f6b5

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-758758b45d from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-758758b45d

SuccessfulCreate

Created pod: payload-processing-external-model-758758b45d-bpnfm
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-758758b45d

FailedCreate

Error creating: pods "payload-processing-external-model-758758b45d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-bpnfm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-758758b45d-bpnfm

AddedInterface

Add eth0 [10.133.1.22/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-bpnfm

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-bpnfm

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-bpnfm

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c

SuccessfulCreate

Created pod: e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

openshift-ingress

deployment-controller

e2e-worker-single-main-042f4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-042f4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-042f4c

openshift-ingress

multus

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

AddedInterface

Add eth0 [10.133.1.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-042f4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-042f4c-6b668c9898 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-042f4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccfdc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccfdc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccfdc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-042f4c: serviceaccount "payload-processing-e2e-worker-single-main-042f4c" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82

AddedInterface

Add eth0 [10.133.1.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccfdc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-042f4c-6b668c9898

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-042f4c-6b668c9898

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-042f4c-6b668c9898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-042f4c: serviceaccount "payload-processing-e2e-worker-single-main-042f4c" not found

openshift-ingress

multus

payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

Unhealthy

Readiness probe failed: Get "http://10.133.1.38:15021/healthz/ready": read tcp 10.133.0.2:58250->10.133.1.38:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

ProbeError

Readiness probe error: Get "http://10.133.1.38:15021/healthz/ready": read tcp 10.133.0.2:58250->10.133.1.38:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

Unhealthy

Startup probe failed: Get "http://10.133.1.38:15021/healthz/ready": dial tcp 10.133.1.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

ProbeError

Startup probe error: Get "http://10.133.1.38:15021/healthz/ready": dial tcp 10.133.1.38:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-042f4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-042f4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-042f4c-openshift-default-54d9f7fc7c98rpn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-042f4c-6b668c9895n9ps

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-042f4c-9d7ccjrh82

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-tcmbg

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-tcmbg

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-7nhv2
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-7nhv2

AddedInterface

Add eth0 [10.133.1.43/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7nhv2

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7nhv2

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7nhv2

Created

Container created
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7nhv2_0ba6e22b-92a1-48fc-b0d5-679b14a217da

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-7nhv2_0ba6e22b-92a1-48fc-b0d5-679b14a217da became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

ProbeError

Readiness probe error: Get "http://10.133.1.10:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-mfjwn

Unhealthy

Readiness probe failed: Get "http://10.133.1.10:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-smfn4

ProbeError

Readiness probe error: Get "http://10.132.1.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-smfn4

Unhealthy

Readiness probe failed: Get "http://10.132.1.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gl57g

Unhealthy

Readiness probe failed: Get "http://10.132.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-gl57g

ProbeError

Readiness probe error: Get "http://10.132.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

Unhealthy

Readiness probe failed: Get "http://10.134.0.160:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hwcsp

ProbeError

Readiness probe error: Get "http://10.134.0.160:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

Unhealthy

Readiness probe failed: Get "http://10.133.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-c99g8

ProbeError

Readiness probe error: Get "http://10.133.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

Unhealthy

Readiness probe failed: Get "http://10.133.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-h7nkg

ProbeError

Readiness probe error: Get "http://10.133.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

Unhealthy

Readiness probe failed: Get "http://10.134.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-hz6cz

ProbeError

Readiness probe error: Get "http://10.134.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-txlk4

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f694df8bc-txlk4

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: