Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-a-14600f-79c884495f-zj52s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-14600f-79c884495f-zj52s to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc to ip-10-0-140-194.us-west-2.compute.internal

ai-tenants

e2e-api-a-a16786

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-a16786: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-d4fdeb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-d4fdeb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-070d07

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-070d07: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-2260d8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-2260d8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-7a7f22

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-7a7f22: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-87af9c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-87af9c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-dffe64

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-dffe64: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-856ddc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-856ddc: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-c7585c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-c7585c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-d247af

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-d247af: MaasTenantConfig is terminating and cannot restore revocation operands

ai-tenants

e2e-extmod-a-d253a5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-d253a5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-d8190b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-d8190b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-e8fa21

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-e8fa21: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-0d5219

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-0d5219: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-1f1314

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-1f1314: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-83f052

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-83f052: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-c42c43

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-c42c43: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-e53098

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-e53098: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-f0e007

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-f0e007: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-243a29

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-243a29: MaasTenantConfig is terminating and cannot restore revocation operands

ai-tenants

e2e-inf-b-6f30f2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-6f30f2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-e679fe

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-e679fe: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-14600f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-14600f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-5d3f8a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-5d3f8a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-8b4030

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-8b4030: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-a32cdb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-a32cdb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-e1aad0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-e1aad0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-18d5f6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-18d5f6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-5d3964

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-5d3964: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-c35264

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-c35264: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-c561e3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-c561e3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-ca15df

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-ca15df: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-26c74d32

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-26c74d32: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-6f9fd2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-6f9fd2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-da5481

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-da5481: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-dab9ee

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-dab9ee: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-de2877

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-de2877: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-03d737

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-03d737: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-8b85a6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-8b85a6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-d22078

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-d22078: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-e2f0bd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-e2f0bd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-fc85c7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-fc85c7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-5901fe

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-5901fe: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-861dfd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-861dfd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-2339ed

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-2339ed: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-93f411

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-93f411: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-cfbb5b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-cfbb5b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-a5f70c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-a5f70c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-502ec2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-502ec2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-c0d50c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-c0d50c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-single-main-bbc981

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-single-main-bbc981: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-processing-e2e-ipp-b-c35264-74c6497b4f-wmc9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c35264-74c6497b4f-wmc9m to ip-10-0-134-83.us-west-2.compute.internal

ai-tenants

e2e-worker-w0-7778d0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-7778d0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-d39257

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-d39257: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-b59563

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-b59563: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-dd5b85

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-dd5b85: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-9360eb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-9360eb: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-hlfv6

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-hlfv6 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-fbhj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-fbhj4 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-e1aad0-557979479d-49tzc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e1aad0-557979479d-49tzc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c561e3-645dc66449-jzksj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c561e3-645dc66449-jzksj to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-mfnpk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-mfnpk to ip-10-0-140-194.us-west-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-rhsg5

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-rhsg5 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-ca15df-54c955d64c-lh7nm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ca15df-54c955d64c-lh7nm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-ca15df-598f689fdd-dt47z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ca15df-598f689fdd-dt47z to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-bac33a89-c758d7c89-hkhwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-bac33a89-c758d7c89-hkhwm to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e863e405-openshift-default-678bb86885-cv9bb to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-7pq8r

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-7pq8r to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-wwfsg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-wwfsg to ip-10-0-139-164.us-west-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-w4fx7

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-w4fx7 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-4xztp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-4xztp to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-5jwhp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-5jwhp to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-kzhcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-kzhcz to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-p46xh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-p46xh to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-qwnr5

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-qwnr5 to ip-10-0-139-164.us-west-2.compute.internal

opendatahub

test-curl-7205-671367

Scheduled

Successfully assigned opendatahub/test-curl-7205-671367 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-kwxpq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-kwxpq to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4 to ip-10-0-134-83.us-west-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-ft5cj

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-ft5cj to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2f427162-openshift-default-8b8547849-9wg6j to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-87af9c-openshift-default-85d666bc67-p799k to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

Scheduled

Successfully assigned openshift-ingress/e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-l7tkw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-l7tkw to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94 to ip-10-0-139-164.us-west-2.compute.internal

opendatahub

test-curl-7205-5c0940

Scheduled

Successfully assigned opendatahub/test-curl-7205-5c0940 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2 to ip-10-0-139-164.us-west-2.compute.internal

kuadrant-system

authorino-57f7f8659f-5xxbf

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-5xxbf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7845f94dd5slg5v

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5slg5v to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

Scheduled

Successfully assigned openshift-ingress/e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-jk294

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-jk294 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-ft2ch

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-ft2ch to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-thrn7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-thrn7 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-rphxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-rphxz to ip-10-0-140-194.us-west-2.compute.internal

kuadrant-system

authorino-5d8444996-2rgdr

Scheduled

Successfully assigned kuadrant-system/authorino-5d8444996-2rgdr to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv to ip-10-0-134-83.us-west-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-w9xp2

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-w9xp2 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww to ip-10-0-139-164.us-west-2.compute.internal

kuadrant-system

authorino-74ff8459f7-x7rcs

Scheduled

Successfully assigned kuadrant-system/authorino-74ff8459f7-x7rcs to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf to ip-10-0-139-164.us-west-2.compute.internal

kuadrant-system

authorino-d44779cff-9cj59

Scheduled

Successfully assigned kuadrant-system/authorino-d44779cff-9cj59 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm to ip-10-0-139-164.us-west-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-dwqhg

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-dwqhg to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-qsdqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-qsdqj to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-zd5vb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-zd5vb to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

test-curl-7205-4dcafd

Scheduled

Successfully assigned opendatahub/test-curl-7205-4dcafd to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-da5481-84569569df-g4kvp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-da5481-84569569df-g4kvp to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-dab9ee-6d996d455-8lcdf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-dab9ee-6d996d455-8lcdf to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-de2877-b45b7ff7-lqwp8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-de2877-b45b7ff7-lqwp8 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-03d737-7b9f454cf7-b6x5x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-03d737-7b9f454cf7-b6x5x to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-8b85a6-fc886dbf-wv89z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-8b85a6-fc886dbf-wv89z to ip-10-0-139-164.us-west-2.compute.internal

opendatahub

test-curl-7205-2b0ef4

Scheduled

Successfully assigned opendatahub/test-curl-7205-2b0ef4 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-14600f-5f64db76dd-hqbfz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-14600f-5f64db76dd-hqbfz to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-p4rbk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-p4rbk to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-l2lj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-l2lj8 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc to ip-10-0-140-194.us-west-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-mxvkt

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-mxvkt to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-6xsnb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-6xsnb to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-14600f-5f4b947575-g4l68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-14600f-5f4b947575-g4l68 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-r49c9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-r49c9 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-6f30f2-66f76ccb97-qnt8n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-6f30f2-66f76ccb97-qnt8n to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-26c74d32-b558f8d67-kvxgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-26c74d32-b558f8d67-kvxgr to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-8zhq8

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-8zhq8 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-sqqcg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-sqqcg to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-v8fq4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-v8fq4 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-7sr7p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-7sr7p to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c561e3-779c466475-q8hdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c561e3-779c466475-q8hdr to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-243a29-dd8dddb6f-7kfkw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-243a29-dd8dddb6f-7kfkw to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-729bv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-729bv to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-bfjm2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-bfjm2 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-jkkf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-jkkf6 to ip-10-0-140-194.us-west-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-f4q4d

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-f4q4d to ip-10-0-139-164.us-west-2.compute.internal

opendatahub

test-curl-7199-8f517a

Scheduled

Successfully assigned opendatahub/test-curl-7199-8f517a to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-e53098-5779d5c545-x4rhv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e53098-5779d5c545-x4rhv to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-8sz4f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-8sz4f to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-f48b9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-f48b9 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-83f052-7dcf7f9c85-7gwt5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-83f052-7dcf7f9c85-7gwt5 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-1f1314-7985cfb565-4sz97

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-1f1314-7985cfb565-4sz97 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-0d5219-767499cc67-vpv4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0d5219-767499cc67-vpv4t to ip-10-0-140-194.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-4bvft

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-4bvft to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

test-curl-7199-4079d1

Scheduled

Successfully assigned opendatahub/test-curl-7199-4079d1 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-82k62

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-82k62 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-slpct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-slpct to ip-10-0-140-194.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-ss2vc

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ss2vc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-d253a5-846cf546b7-22cbm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d253a5-846cf546b7-22cbm to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-d247af-57fc994bb7-p5nv6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d247af-57fc994bb7-p5nv6 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-c7585c-c6bd6c7-xtwpk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-c7585c-c6bd6c7-xtwpk to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-856ddc-f64f5dddf-wbt7c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-856ddc-f64f5dddf-wbt7c to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

odh-model-controller-769875db56-hpjht

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-hpjht to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-15000fe0-9676fd9cc-l85jf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-15000fe0-9676fd9cc-l85jf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-dffe64-6b794cbd59-ldmrg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-dffe64-6b794cbd59-ldmrg to ip-10-0-140-194.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-hnxxr

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-hnxxr to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

ai-gateway-controller-5cb476b87b-tk2rk

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5cb476b87b-tk2rk to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-pjvnw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-pjvnw to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-87af9c-789b5d6fb9-snw9s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-87af9c-789b5d6fb9-snw9s to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-7a7f22-cd757844c-4txtc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7a7f22-cd757844c-4txtc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-d39257-6fbd4997d5-bgg6p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-d39257-6fbd4997d5-bgg6p to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-bp9q8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-bp9q8 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-64nnl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-64nnl to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-hmbfh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-hmbfh to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2260d8-85d8f74545-kmhzn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2260d8-85d8f74545-kmhzn to ip-10-0-140-194.us-west-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-bvlnb

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-bvlnb to ip-10-0-139-164.us-west-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-4m5hw

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-4m5hw to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-56t42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-56t42 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-x4whz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-x4whz to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-7jcnf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-7jcnf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-qgjfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-qgjfv to ip-10-0-140-194.us-west-2.compute.internal

llm

e2e-same-id-b-12997f0c-kserve-79fdf5d98f-28768

Scheduled

Successfully assigned llm/e2e-same-id-b-12997f0c-kserve-79fdf5d98f-28768 to ip-10-0-134-83.us-west-2.compute.internal

ai-tenants

e2e-api-a-329d79

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-329d79: MaasTenantConfig is not available to restore revocation operands

kuadrant-system

limitador-limitador-7c9b87d574-7phrx

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-7phrx to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-fs9dl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-fs9dl to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq to ip-10-0-134-83.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6f949c7964-tmk7x to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-4cmbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-4cmbx to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-j6g99

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-j6g99 to ip-10-0-140-194.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-7464ffdbfc-fmsph

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7464ffdbfc-fmsph to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-jqjpt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-jqjpt to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs to ip-10-0-140-194.us-west-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-nmdgv

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-nmdgv to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-070d07-6487b76589-zkd5m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-070d07-6487b76589-zkd5m to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-kfsj2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-kfsj2 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-d4fdeb-75d5585fb9-wnhck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d4fdeb-75d5585fb9-wnhck to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-c4dr8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-c4dr8 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-t4htn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-t4htn to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-zddlk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-zddlk to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-070d07-openshift-default-65f7d87779-6qltx to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-14600f-8678955c47-dnf7c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-14600f-8678955c47-dnf7c to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n to ip-10-0-134-83.us-west-2.compute.internal

ai-tenants

e2e-api-a-5effde

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-5effde: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-gs7pb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-gs7pb to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-kzn8t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-kzn8t to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-6b3a29ec-76cff78f69-5z7bk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6b3a29ec-76cff78f69-5z7bk to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-57djf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-57djf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-243a29-595f587ccf-dp87r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-243a29-595f587ccf-dp87r to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc to ip-10-0-140-194.us-west-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-br9sv

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-br9sv to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q to ip-10-0-140-194.us-west-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-n42bp

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-n42bp to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5 to ip-10-0-140-194.us-west-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-psl4l

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-psl4l to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-2kz8v

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-2kz8v to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-hr6hb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-hr6hb to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-5dpw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-5dpw5 to ip-10-0-134-83.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-6b9b48ccc9-qt58k

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6b9b48ccc9-qt58k to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c35264-5f6b77cf46-zgnmc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c35264-5f6b77cf46-zgnmc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-68rm8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-68rm8 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-942wm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-942wm to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-cmg7d

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cmg7d to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-qrklv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qrklv to ip-10-0-134-83.us-west-2.compute.internal

llm

e2e-prio-pool-7010fecc-kserve-587655c754-zr7gl

Scheduled

Successfully assigned llm/e2e-prio-pool-7010fecc-kserve-587655c754-zr7gl to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-c42c43-65465649bc-c5xxw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-c42c43-65465649bc-c5xxw to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-q9qrf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-q9qrf to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-qj6lg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-qj6lg to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-zszdg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-zszdg to ip-10-0-134-83.us-west-2.compute.internal

opendatahub

test-curl-7205-7a9a33

Scheduled

Successfully assigned opendatahub/test-curl-7205-7a9a33 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-26c74d32-6747c4bc7c-llhgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-26c74d32-6747c4bc7c-llhgz to ip-10-0-134-83.us-west-2.compute.internal

llm

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

Scheduled

Successfully assigned llm/e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

maas-controller-7c946769f6-k59sv

Scheduled

Successfully assigned opendatahub/maas-controller-7c946769f6-k59sv to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-a16786-77487b7677-frnsn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a16786-77487b7677-frnsn to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

maas-controller-7c946769f6-7vw7l

Scheduled

Successfully assigned opendatahub/maas-controller-7c946769f6-7vw7l to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-5effde-c88b56d97-449fp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5effde-c88b56d97-449fp to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-329d79-5b55f4444c-xm7lp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-329d79-5b55f4444c-xm7lp to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-e863e405-b4bdcb495-55jgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e863e405-b4bdcb495-55jgq to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

maas-controller-7c946769f6-6pgn5

Scheduled

Successfully assigned opendatahub/maas-controller-7c946769f6-6pgn5 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-hxt9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-hxt9c to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-18d5f6-cc56d555-bspdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-18d5f6-cc56d555-bspdn to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-5d3964-5566fb7949-kpzrh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5d3964-5566fb7949-kpzrh to ip-10-0-140-194.us-west-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bk6x5 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-api-a-329d79-openshift-default-575867c7-zmd79

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-329d79-openshift-default-575867c7-zmd79 to ip-10-0-140-194.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-6b9b48ccc9-chpnh

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6b9b48ccc9-chpnh to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-6lxkk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-6lxkk to ip-10-0-140-194.us-west-2.compute.internal

llm

e2e-same-id-a-12997f0c-kserve-6686955949-lf42k

Scheduled

Successfully assigned llm/e2e-same-id-a-12997f0c-kserve-6686955949-lf42k to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-sdx7g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-sdx7g to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-vt6qv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-vt6qv to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-fdkss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-fdkss to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-zlb2z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-zlb2z to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-7qg7x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-7qg7x to ip-10-0-134-83.us-west-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-lzxbn

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-lzxbn to ip-10-0-139-164.us-west-2.compute.internal

opendatahub

maas-controller-55c9cb6786-fld89

Scheduled

Successfully assigned opendatahub/maas-controller-55c9cb6786-fld89 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-2f427162-574d49d87-nbrpt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2f427162-574d49d87-nbrpt to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-processing-79468f7c9f-559sl

Scheduled

Successfully assigned openshift-ingress/payload-processing-79468f7c9f-559sl to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-597dbd485d-sbjjw

Scheduled

Successfully assigned openshift-ingress/payload-processing-597dbd485d-sbjjw to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-k2qfn

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-k2qfn to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr to ip-10-0-140-194.us-west-2.compute.internal

llm

e2e-same-id-a-12997f0c

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-12997f0c

opendatahub

llmisvc-controller-manager-869d5dcc5d-sb49s

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-sb49s to ip-10-0-139-164.us-west-2.compute.internal

opendatahub

test-curl-7205-70ec18

Scheduled

Successfully assigned opendatahub/test-curl-7205-70ec18 to ip-10-0-134-83.us-west-2.compute.internal

ai-tenants

e2e-worker-single-main-cc1991

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-single-main-cc1991: MaasTenantConfig is not available to restore revocation operands

models-as-a-service

payload-processing-external-model-5dfbf6cc9d-sxpft

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5dfbf6cc9d-sxpft to ip-10-0-140-194.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6f949c7964-nnksg

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6f949c7964-nnksg to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb to ip-10-0-140-194.us-west-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-6db6df8475-ktgnj

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-6db6df8475-ktgnj to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml to ip-10-0-139-164.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-55bb6bdfd4-xdcbf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-55bb6bdfd4-xdcbf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-9cfb9b656-jtls9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-9cfb9b656-jtls9 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-9pzbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-9pzbs to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-6545dbfb5c-prvtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6545dbfb5c-prvtw to ip-10-0-134-83.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-55bb6bdfd4-l5dgm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-55bb6bdfd4-l5dgm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5effde-578cb47bf5-5njq8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5effde-578cb47bf5-5njq8 to ip-10-0-140-194.us-west-2.compute.internal

llm

e2e-same-id-b-12997f0c

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-12997f0c

llm

e2e-same-id-b-12997f0c

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-4mdxf

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-4mdxf to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-vkrml

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vkrml to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-5c4sl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-5c4sl to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-cb6b5fd89-vj58j

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-cb6b5fd89-vj58j to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-rfs7m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-rfs7m to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-dffe64-7c97ff4879-mmcqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-dffe64-7c97ff4879-mmcqp to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-cb6b5fd89-w7s8t

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-cb6b5fd89-w7s8t to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f to ip-10-0-140-194.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-5bcd7997-lqzd2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-lqzd2 to ip-10-0-134-83.us-west-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8v2xw5

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8v2xw5 to ip-10-0-134-83.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-cmm9t

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-cmm9t to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq to ip-10-0-140-194.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6f949c7964-lgm6x to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-pghvs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-pghvs to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-9hfcq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-9hfcq to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-22gdr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-22gdr to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-5smg5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-5smg5 to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-6rp2d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6rp2d to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-76m8v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-76m8v to ip-10-0-139-164.us-west-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-ns4fr

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-ns4fr to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-9sp48

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9sp48 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-bgjqj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-bgjqj to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-bwzrc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-bwzrc to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-cb4gc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cb4gc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-ddzvr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-ddzvr to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-dffz2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-dffz2 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-flbbt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-flbbt to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-fwqzv to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-gh4g9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gh4g9 to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-gl6cz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gl6cz to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-h2zq7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-h2zq7 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-h4vrf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-h4vrf to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-329d79-948cb787f-kdr5w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-329d79-948cb787f-kdr5w to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-hbjsw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-hbjsw to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-hxx62

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-hxx62 to ip-10-0-140-194.us-west-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-hv9rw

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-hv9rw to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-jdrnv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-jdrnv to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-jg5sl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-jg5sl to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-jlkc2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-jlkc2 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-lqmhm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-lqmhm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-lxq9w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-lxq9w to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-nhf4g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-nhf4g to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-npjlx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-npjlx to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-pflrt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-pflrt to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-ppc6s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-ppc6s to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-pzd8p

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-pzd8p to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-qcfrt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qcfrt to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-rpg88

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rpg88 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-vh5lb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vh5lb to ip-10-0-139-164.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-wlt76

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-wlt76 to ip-10-0-139-164.us-west-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6886b96f9-zp2v6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-zp2v6 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2260d8-5594b76647-zrzgn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2260d8-5594b76647-zrzgn to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-070d07-7f49b754c5-7crbb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-070d07-7f49b754c5-7crbb to ip-10-0-140-194.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-5b7c6c55f6-7m6tv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5b7c6c55f6-7m6tv to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-55f56bc75f-vd5ph

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-vd5ph to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-msmln

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-msmln to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

router-default-6489c4dbb7-6rbbc

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

Scheduled

Successfully assigned openshift-ingress/e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

router-default-6489c4dbb7-6rbbc

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

router-default-6489c4dbb7-6rbbc

Scheduled

Successfully assigned openshift-ingress/router-default-6489c4dbb7-6rbbc to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6 to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a16786-768455c76c-scw9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a16786-768455c76c-scw9s to ip-10-0-140-194.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-54b7cc8547-64sbm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-54b7cc8547-64sbm to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt to ip-10-0-139-164.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-57fdb56688-j2l9b

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-57fdb56688-j2l9b to ip-10-0-134-83.us-west-2.compute.internal

openshift-ingress

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv to ip-10-0-140-194.us-west-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6489c4dbb7 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-6489c4dbb7

SuccessfulCreate

Created pod: router-default-6489c4dbb7-6rbbc
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-6489c4dbb7-6rbbc

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6489c4dbb7-6rbbc

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-6489c4dbb7-6rbbc

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6489c4dbb7-6rbbc

Created

Container created

openshift-ingress

kubelet

router-default-6489c4dbb7-6rbbc

Started

Container started

openshift-ingress

kubelet

router-default-6489c4dbb7-6rbbc

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-2kz8v

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kz8v

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-2kz8v

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kz8v

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kz8v

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.018s (4.018s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kz8v

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kz8v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kz8v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-22gdr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-55f56bc75f from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-55f56bc75f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-55f56bc75f-vd5ph

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-22gdr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-55f56bc75f-vd5ph

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-22gdr

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-55f56bc75f-vd5ph

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-22gdr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.34s (11.34s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-55f56bc75f-vd5ph

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.315s (12.315s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-55f56bc75f-vd5ph

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-55f56bc75f-vd5ph

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6f949c7964-tmk7x

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6f949c7964-nnksg

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6f949c7964

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6f949c7964-lgm6x

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-6f949c7964 from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6f949c7964-lgm6x

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6f949c7964

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6f949c7964-nnksg

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6f949c7964

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6f949c7964-tmk7x

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-nnksg

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-nnksg

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 5.244s (5.244s including waiting). Image size: 273709574 bytes.
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-nnksg

Created

Container created
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-nnksg

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-nnksg

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-7cql9

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-nnksg

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 881ms (881ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-nnksg

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-nnksg

Started

Container started

opendatahub-operator-system

opendatahub-operator-controller-manager-6f949c7964-nnksg_c0359b05-b7ca-4df9-a0bc-fc1a76a9b895

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-6f949c7964-nnksg_c0359b05-b7ca-4df9-a0bc-fc1a76a9b895 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 10.339s (10.339s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 10.736s (10.736s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-lgm6x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 921ms (921ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 898ms (898ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6f949c7964-tmk7x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-lzxbn

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-lzxbn

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-lzxbn

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-w4fx7

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-w4fx7

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-w4fx7

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-lzxbn

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.821s (3.821s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-lzxbn

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-lzxbn

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-lzxbn_266280e2-b462-418c-b8cb-3905d3bdeb00 became leader
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-w4fx7

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-w4fx7

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-w4fx7

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.583s (4.583s including waiting). Image size: 309650901 bytes.

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-rhsg5

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-rhsg5

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-rhsg5

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-hnxxr

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-hnxxr

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-hnxxr

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors
(x12)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-rhsg5

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-rhsg5

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-rhsg5

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.705s (3.705s including waiting). Image size: 309650901 bytes.

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-mxvkt

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-mxvkt

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-mxvkt

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-nmdgv

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-nmdgv

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-hnxxr

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-hnxxr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 6.295s (6.295s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-mxvkt

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-hnxxr

Started

Container started

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-nmdgv

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-mxvkt

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-mxvkt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.982s (2.982s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-mxvkt_094c26ff-8a6a-47ad-804f-82cc76697690

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-mxvkt_094c26ff-8a6a-47ad-804f-82cc76697690 became leader

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-hnxxr_0dd42c07-eda6-45b0-8e11-58a1fc0684bb

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-hnxxr_0dd42c07-eda6-45b0-8e11-58a1fc0684bb became leader

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-dwqhg

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-dwqhg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-dwqhg

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-nmdgv

Created

Container created

kuadrant-system

limitador-operator-controller-manager-5778bb4449-nmdgv_9291adbe-d375-43bb-90e3-837bd8f9cb01

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-nmdgv_9291adbe-d375-43bb-90e3-837bd8f9cb01 became leader

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-hlfv6

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-nmdgv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 4.035s (4.035s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-nmdgv

Started

Container started

cert-manager

multus

cert-manager-597b95cb84-hlfv6

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

cert-manager

kubelet

cert-manager-597b95cb84-hlfv6

Started

Container started

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-f4q4d

cert-manager

kubelet

cert-manager-597b95cb84-hlfv6

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-hlfv6

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-f4q4d

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-f4q4d

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

authorino-operator-7b7bb4bc77-dwqhg_dbc2872c-350b-4175-b949-e09580805215

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-dwqhg_dbc2872c-350b-4175-b949-e09580805215 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-dwqhg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.727s (2.727s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-dwqhg

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-dwqhg

Started

Container started

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-h6ttt"

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-cb6b5fd89 from 0 to 2

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-n8tqf"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-ss2vc

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-f4q4d

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.444s (6.444s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-f4q4d

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-f4q4d

Started

Container started

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7845f94dd5 from 0 to 1

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-ss2vc

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-ss2vc

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-ss2vc

Started

Container started

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-ingress

multus

kube-auth-proxy-cb6b5fd89-vj58j

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-cb6b5fd89

SuccessfulCreate

Created pod: kube-auth-proxy-cb6b5fd89-w7s8t

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-cb6b5fd89

SuccessfulCreate

Created pod: kube-auth-proxy-cb6b5fd89-vj58j

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7845f94dd5

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7845f94dd5slg5v

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-ss2vc

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-cb6b5fd89-w7s8t

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-ingress

multus

kube-auth-proxy-cb6b5fd89-w7s8t

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-cb6b5fd89-vj58j

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7845f94dd5slg5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7845f94dd5slg5v

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7845f94dd5slg5v

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7845f94dd5slg5v

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-bvlnb

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

limitador-limitador-74dfcfb894-bvlnb

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-6db6df8475 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-cb6b5fd89-vj58j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.901s (2.901s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-cb6b5fd89-vj58j

Created

Container created

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-6db6df8475

SuccessfulCreate

Created pod: jobset-controller-manager-6db6df8475-ktgnj

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-bvlnb

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-cb6b5fd89-w7s8t

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

kube-auth-proxy-cb6b5fd89-w7s8t

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-cb6b5fd89-w7s8t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.244s (3.244s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-cb6b5fd89-vj58j

Started

Container started

openshift-jobset-operator

multus

jobset-controller-manager-6db6df8475-ktgnj

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-6db6df8475-ktgnj

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-bvlnb

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-bvlnb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.27s (2.27s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-bvlnb

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-6db6df8475-ktgnj

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-6db6df8475-ktgnj

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-6db6df8475-ktgnj

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.547s (4.547s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

jobset-controller-manager-6db6df8475-ktgnj_6c0cceaa-59dc-42d9-850d-095a80c730c8

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-6db6df8475-ktgnj_6c0cceaa-59dc-42d9-850d-095a80c730c8 became leader

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-hnxxr

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-hnxxr

Killing

Stopping container manager

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-7pq8r

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-7pq8r

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-7pq8r

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-7pq8r

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-7pq8r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 3.216s (3.216s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-7pq8r

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-ss2vc_3bd1f8d9-859b-4900-97da-cf7840c01253

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-ss2vc_3bd1f8d9-859b-4900-97da-cf7840c01253 became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-7phrx

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

multus

limitador-limitador-7c9b87d574-7phrx

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-7phrx

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-5xxbf

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

multus

authorino-57f7f8659f-5xxbf

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-5xxbf

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-7phrx

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-7phrx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.038s (2.038s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-7phrx

Started

Container started

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-ft5cj

kuadrant-system

multus

authorino-56c6c9ddd5-ft5cj

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-ft5cj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-57f7f8659f-5xxbf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.151s (3.151s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-5xxbf

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-5xxbf

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-ft5cj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.931s (2.931s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-ft5cj

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-ft5cj

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-5xxbf

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-5xxbf

opendatahub

kserve-module-controller-manager-7566cf5fc8-7pq8r_9a507b76-3916-4247-895d-108445eeff1a

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-7pq8r_9a507b76-3916-4247-895d-108445eeff1a became leader

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-bvlnb

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-bvlnb

opendatahub

replicaset-controller

maas-controller-55c9cb6786

SuccessfulCreate

Created pod: maas-controller-55c9cb6786-fld89

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-55c9cb6786 from 0 to 1

opendatahub

replicaset-controller

maas-controller-7c946769f6

SuccessfulCreate

Created pod: maas-controller-7c946769f6-k59sv

opendatahub

kubelet

maas-controller-55c9cb6786-fld89

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:a2feb5b4c34bf082ebc90c7906eea6aa0d70053da5b81e9eb6106962997f1de2"

opendatahub

multus

maas-controller-55c9cb6786-fld89

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

opendatahub

multus

maas-controller-7c946769f6-k59sv

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7c946769f6-k59sv

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:a2feb5b4c34bf082ebc90c7906eea6aa0d70053da5b81e9eb6106962997f1de2"

opendatahub

kubelet

maas-controller-7c946769f6-k59sv

Started

Container started

opendatahub

kubelet

maas-controller-7c946769f6-k59sv

Created

Container created

opendatahub

kubelet

maas-controller-7c946769f6-k59sv

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:a2feb5b4c34bf082ebc90c7906eea6aa0d70053da5b81e9eb6106962997f1de2" in 7.221s (7.221s including waiting). Image size: 200094743 bytes.

opendatahub

kubelet

maas-controller-55c9cb6786-fld89

Started

Container started

opendatahub

kubelet

maas-controller-55c9cb6786-fld89

Created

Container created

opendatahub

kubelet

maas-controller-55c9cb6786-fld89

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:a2feb5b4c34bf082ebc90c7906eea6aa0d70053da5b81e9eb6106962997f1de2" in 7.863s (7.863s including waiting). Image size: 200094743 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-vkrml

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vkrml

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-vkrml

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

opendatahub

maas-controller-55c9cb6786-fld89_efd069b4-b378-4c0f-a741-0c05b73e8172

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-55c9cb6786-fld89_efd069b4-b378-4c0f-a741-0c05b73e8172 became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-sb49s

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-4m5hw

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-qwnr5

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-hpjht

opendatahub

kubelet

model-serving-api-75bd89fdfc-4m5hw

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

odh-model-controller-769875db56-hpjht

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

multus

model-serving-api-75bd89fdfc-4m5hw

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sb49s

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-sb49s

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vkrml

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-hpjht

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qwnr5

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vkrml

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.518s (5.518s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vkrml

Created

Container created

opendatahub

multus

kserve-controller-manager-776cc66d47-qwnr5

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vkrml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vkrml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

model-serving-api-75bd89fdfc-4m5hw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.146s (3.146s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-4m5hw

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-4m5hw

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sb49s

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sb49s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.391s (4.391s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sb49s

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qwnr5

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

odh-model-controller-769875db56-hpjht

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.836s (4.836s including waiting). Image size: 236755567 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kz8v

Killing

Stopping container discovery

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qwnr5

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.736s (4.736s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qwnr5

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-hpjht

Created

Container created

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-2kz8v

opendatahub

kubelet

odh-model-controller-769875db56-hpjht

Started

Container started

opendatahub

kubelet

maas-controller-55c9cb6786-fld89

Killing

Stopping container manager

opendatahub

odh-model-controller-769875db56-hpjht_e4fe8f28-b8dc-4830-a40d-36629f261c19

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-hpjht_e4fe8f28-b8dc-4830-a40d-36629f261c19 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-sb49s_0580e974-1761-499c-b7bc-f29b70b1ca1f

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-sb49s_0580e974-1761-499c-b7bc-f29b70b1ca1f became leader

opendatahub

kserve-controller-manager-776cc66d47-qwnr5_91939cb8-ef86-4e91-afc1-f116277bca16

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-qwnr5_91939cb8-ef86-4e91-afc1-f116277bca16 became leader

opendatahub

replicaset-controller

maas-controller-55c9cb6786

SuccessfulDelete

Deleted pod: maas-controller-55c9cb6786-fld89

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-55c9cb6786 from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 15.547s (15.547s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-bk6x5

Created

Container created

opendatahub

maas-controller-7c946769f6-k59sv_b555b5f4-72f7-4f34-a624-8af487ac65ce

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7c946769f6-k59sv_b555b5f4-72f7-4f34-a624-8af487ac65ce became leader
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-74ff8459f7 from 0 to 1
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-22gdr

Created

Container created

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-w9xp2
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-22gdr

Started

Container started

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-w9xp2

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-74ff8459f7

SuccessfulCreate

Created pod: authorino-74ff8459f7-x7rcs

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-22gdr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-74ff8459f7 from 1 to 0

kuadrant-system

multus

authorino-d44779cff-9cj59

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-74ff8459f7-x7rcs

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-74ff8459f7-x7rcs

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-d44779cff from 0 to 1

kuadrant-system

kubelet

authorino-6f6944bcdd-w9xp2

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6f6944bcdd-w9xp2

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-d44779cff

SuccessfulCreate

Created pod: authorino-d44779cff-9cj59

kuadrant-system

replicaset-controller

authorino-74ff8459f7

SuccessfulDelete

Deleted pod: authorino-74ff8459f7-x7rcs

kuadrant-system

kubelet

authorino-6f6944bcdd-w9xp2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.757s (1.757s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-w9xp2

Started

Container started

kuadrant-system

kubelet

authorino-d44779cff-9cj59

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6f6944bcdd-w9xp2

Created

Container created

kuadrant-system

kubelet

authorino-d44779cff-9cj59

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.653s (1.653s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-74ff8459f7-x7rcs

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.547s (1.547s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-d44779cff-9cj59

Started

Container started

kuadrant-system

kubelet

authorino-74ff8459f7-x7rcs

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-74ff8459f7-x7rcs

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-w9xp2

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-74ff8459f7-x7rcs

Started

Container started

kuadrant-system

kubelet

authorino-d44779cff-9cj59

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-ft5cj

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-ft5cj

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-22gdr

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-22gdr

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-cmm9t

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-cmm9t

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-cmm9t

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-cmm9t

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-cmm9t

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-cmm9t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 859ms (859ms including waiting). Image size: 235100981 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-sb49s

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sb49s

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-8zhq8

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8zhq8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-8zhq8

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8zhq8

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8zhq8

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8zhq8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 4.792s (4.792s including waiting). Image size: 183979433 bytes.

opendatahub

ai-gateway-controller-7d85675f98-8zhq8_4b2b8f96-d51e-40ef-bbca-ceac671564b8

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-8zhq8_4b2b8f96-d51e-40ef-bbca-ceac671564b8 became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-9pzbs
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9pzbs

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-k2qfn

openshift-ingress

multus

payload-pre-processing-7b98bb678c-9pzbs

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-55fbbbf9dc-k2qfn

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-k2qfn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-k2qfn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.983s (2.983s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9pzbs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.022s (3.022s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9pzbs

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-k2qfn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9pzbs

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-k2qfn

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-cmm9t_03f423e0-1986-4735-9135-7eb61c9b37b3

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-cmm9t_03f423e0-1986-4735-9135-7eb61c9b37b3 became leader

opendatahub

replicaset-controller

ai-gateway-controller-5cb476b87b

SuccessfulCreate

Created pod: ai-gateway-controller-5cb476b87b-tk2rk

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5cb476b87b from 0 to 1

opendatahub

multus

ai-gateway-controller-5cb476b87b-tk2rk

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-5cb476b87b-tk2rk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-5cb476b87b-tk2rk

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5cb476b87b-tk2rk

Started

Container started

opendatahub

kubelet

ai-gateway-controller-5cb476b87b-tk2rk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 934ms (934ms including waiting). Image size: 183979433 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8zhq8

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-8zhq8

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-br9sv

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-br9sv

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-br9sv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-br9sv

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-br9sv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.244s (2.244s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-br9sv

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-n42bp

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-n42bp

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-n42bp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-n42bp

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-n42bp

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-n42bp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 602ms (602ms including waiting). Image size: 98346788 bytes.

opendatahub

ai-gateway-controller-5cb476b87b-tk2rk_a0e5a8a3-b7f2-4fdc-9885-ca7900c064b4

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5cb476b87b-tk2rk_a0e5a8a3-b7f2-4fdc-9885-ca7900c064b4 became leader

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-psl4l

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-psl4l

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-psl4l

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-psl4l

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-psl4l

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 605ms (605ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-psl4l

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-4mdxf

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-4mdxf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-4mdxf

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-4mdxf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 632ms (632ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-4mdxf

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-4mdxf

Created

Container created

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8v2xw5

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8v2xw5

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8v2xw5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8v2xw5

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8v2xw5

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8v2xw5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 621ms (621ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

kubelet

echo-simulator-kserve-64b6f8f96c-ns4fr

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-ns4fr

llm

multus

echo-simulator-kserve-64b6f8f96c-ns4fr

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-ns4fr

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-hv9rw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-hv9rw

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-hv9rw

llm

kubelet

echo-simulator-kserve-64b6f8f96c-ns4fr

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-ns4fr

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.476s (2.476s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-hv9rw

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-hv9rw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.621s (1.621s including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-hv9rw

Started

Container started

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 615ms (615ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-pflrt

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-pflrt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-hbjsw

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-hbjsw

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 1 to 3

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.866s (4.866s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.868s (4.868s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-hxx62

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-hxx62

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-dffz2

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-dffz2

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 3 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hxx62

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-dffz2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-dffz2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-dffz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hxx62

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hxx62

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-5d8444996

SuccessfulCreate

Created pod: authorino-5d8444996-2rgdr

kuadrant-system

multus

authorino-5d8444996-2rgdr

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5d8444996-2rgdr

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-5d8444996-2rgdr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.983s (1.983s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5d8444996-2rgdr

Created

Container created

kuadrant-system

kubelet

authorino-5d8444996-2rgdr

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-dffz2

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-dffz2

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused

kuadrant-system

kubelet

authorino-d44779cff-9cj59

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-d44779cff

SuccessfulDelete

Deleted pod: authorino-d44779cff-9cj59
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hxx62

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-d44779cff from 1 to 0
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hxx62

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-2f427162

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2f427162

openshift-ingress

gateway_labeler_controller

e2e-ait-4072c5d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4072c5d1

openshift-ingress

deployment-controller

e2e-ait-4072c5d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4072c5d1-openshift-default-fcb679d7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-bac33a89-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-bac33a89-gw

openshift-ingress

replicaset-controller

e2e-ait-4072c5d1-openshift-default-fcb679d7c

SuccessfulCreate

Created pod: e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

openshift-ingress

deployment-controller

e2e-ait-2f427162-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2f427162-openshift-default-8b8547849 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-2f427162-openshift-default-8b8547849

SuccessfulCreate

Created pod: e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

openshift-ingress

replicaset-controller

e2e-migrate-bac33a89-gw-openshift-default-68df85649

SuccessfulCreate

Created pod: e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

openshift-ingress

deployment-controller

e2e-migrate-bac33a89-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-bac33a89-gw-openshift-default-68df85649 from 0 to 1

openshift-ingress

multus

e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-46d24f95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-46d24f95

openshift-ingress

multus

e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-46d24f95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-46d24f95-openshift-default-66b9cf9465 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-46d24f95-openshift-default-66b9cf9465

SuccessfulCreate

Created pod: e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

openshift-ingress

gateway_labeler_controller

e2e-derive-15000fe0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-15000fe0

openshift-ingress

deployment-controller

e2e-derive-15000fe0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-15000fe0-openshift-default-858b57d65c from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-15000fe0-openshift-default-858b57d65c

SuccessfulCreate

Created pod: e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

openshift-ingress

multus

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-bac33a89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-bac33a89-c758d7c89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-bac33a89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-sqqcg

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-bac33a89-c758d7c89

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-bac33a89-c758d7c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-bac33a89: serviceaccount "payload-processing-e2e-migrate-bac33a89" not found

openshift-ingress

multus

payload-processing-e2e-migrate-bac33a89-c758d7c89-hkhwm

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-sqqcg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-sqqcg

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-sqqcg

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-sqqcg

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-bac33a89-c758d7c89

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-bac33a89-c758d7c89-hkhwm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-bac33a89: serviceaccount "payload-processing-e2e-migrate-bac33a89" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-bac33a89-c758d7c89-hkhwm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-bac33a89-c758d7c89-hkhwm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-bac33a89-c758d7c89-hkhwm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2f427162-574d49d87

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2f427162-574d49d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2f427162: serviceaccount "payload-processing-e2e-ait-2f427162" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2f427162-dfd89866c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2f427162-dfd89866c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2f427162: serviceaccount "payload-processing-e2e-ait-2f427162" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2f427162-dfd89866c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2f427162

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2f427162-dfd89866c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2f427162

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2f427162-574d49d87 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-2f427162-574d49d87-nbrpt

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2f427162-574d49d87-nbrpt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2f427162-574d49d87

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2f427162-574d49d87-nbrpt

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4072c5d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4072c5d1-bc5c5b467 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4072c5d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4072c5d1: serviceaccount "payload-processing-e2e-ait-4072c5d1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4072c5d1-bc5c5b467

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4072c5d1-bc5c5b467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4072c5d1: serviceaccount "payload-processing-e2e-ait-4072c5d1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4072c5d1-bc5c5b467

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd

openshift-ingress

multus

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.649s (3.649s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-2f427162-574d49d87-nbrpt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.432s (3.432s including waiting). Image size: 125353965 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-46d24f95-6698fc8f87

SuccessfulCreate

Created pod: payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-46d24f95-6698fc8f87

FailedCreate

Error creating: pods "payload-processing-e2e-ait-46d24f95-6698fc8f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-46d24f95: serviceaccount "payload-processing-e2e-ait-46d24f95" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-2f427162-574d49d87-nbrpt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-2f427162-574d49d87-nbrpt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ait-46d24f95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-46d24f95-6698fc8f87 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-46d24f95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-46d24f95: serviceaccount "payload-processing-e2e-ait-46d24f95" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.83s (2.83s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.049s (2.049s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 867ms (867ms including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 819ms (819ms including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-15000fe0-9676fd9cc

SuccessfulCreate

Created pod: payload-processing-e2e-derive-15000fe0-9676fd9cc-l85jf

openshift-ingress

deployment-controller

payload-processing-e2e-derive-15000fe0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-15000fe0-9676fd9cc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-15000fe0-9676fd9cc

FailedCreate

Error creating: pods "payload-processing-e2e-derive-15000fe0-9676fd9cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-15000fe0: serviceaccount "payload-processing-e2e-derive-15000fe0" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-15000fe0: serviceaccount "payload-processing-e2e-derive-15000fe0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-5c4sl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-15000fe0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-15000fe0-9676fd9cc-l85jf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-15000fe0-9676fd9cc-l85jf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-derive-15000fe0-9676fd9cc-l85jf

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-15000fe0-9676fd9cc-l85jf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-5c4sl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-5c4sl

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-5c4sl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-5c4sl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4072c5d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-bac33a89-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4072c5d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-bac33a89-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2f427162-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2f427162-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4072c5d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4072c5d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-bac33a89-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-bac33a89-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-46d24f95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ait-4072c5d1-bc5c5b467-zhgpd

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-46d24f95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4072c5d1-6c6b757f8c-s9xml

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bac33a89-7d497dd4d7-sqqcg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-bac33a89-c758d7c89-hkhwm

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-15000fe0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-15000fe0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-4072c5d1-openshift-default-fcb679d7c-9ls8f

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2f427162-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2f427162-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-b59563

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-b59563

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

openshift-ingress

kubelet

e2e-migrate-bac33a89-gw-openshift-default-68df85649-2m84r

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-dd5b85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-dd5b85

openshift-ingress

kubelet

payload-processing-e2e-ait-2f427162-574d49d87-nbrpt

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w3-dd5b85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f427162-dfd89866c-qxfph

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-15000fe0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-15000fe0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-derive-15000fe0-9676fd9cc-l85jf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15000fe0-6d64fb97f5-5c4sl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-2f427162-openshift-default-8b8547849-9wg6j

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-9360eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-9360eb

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-b59563

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-b59563-6545bb797f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-b59563: serviceaccount "payload-processing-e2e-worker-w2-b59563" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-b59563: serviceaccount "payload-processing-e2e-worker-w2-b59563" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-b59563

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-b59563-7b58f8bfc5 from 0 to 1

openshift-ingress

kubelet

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr

Created

Container created

openshift-ingress

kubelet

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr

openshift-ingress

kubelet

e2e-derive-15000fe0-openshift-default-858b57d65c-rg7vb

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-d39257

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-d39257
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-dd5b85: serviceaccount "payload-processing-e2e-worker-w3-dd5b85" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-dd5b85: serviceaccount "payload-processing-e2e-worker-w3-dd5b85" not found

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-dd5b85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-dd5b85-6f75c7b449 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-dd5b85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-46d24f95-6698fc8f87-glxd5

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46d24f95-657bfdc4c5-mbwkq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-46d24f95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-46d24f95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-9360eb: serviceaccount "payload-processing-e2e-worker-w4-9360eb" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-9360eb-7cc4854c7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-9360eb-7cc4854c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-9360eb: serviceaccount "payload-processing-e2e-worker-w4-9360eb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-9360eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-9360eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-9360eb-7cc4854c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-9360eb-7cc4854c7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-d39257

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-d39257-6847b799d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-d39257-6847b799d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-d39257: serviceaccount "payload-processing-e2e-worker-w1-d39257" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-d39257

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-d39257-6fbd4997d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-d39257-6847b799d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-rfs7m

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-d39257-6fbd4997d5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-d39257-6fbd4997d5-bgg6p
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-d39257-6fbd4997d5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-d39257-6fbd4997d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-d39257: serviceaccount "payload-processing-e2e-worker-w1-d39257" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-rfs7m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d39257-6fbd4997d5-bgg6p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-rfs7m

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-rfs7m

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w1-d39257-6fbd4997d5-bgg6p

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d39257-6fbd4997d5-bgg6p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-rfs7m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d39257-6fbd4997d5-bgg6p

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-7778d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-7778d0

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 0 to 1

openshift-ingress

kubelet

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-46d24f95-openshift-default-66b9cf9465-tdss8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-7778d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7778d0-54f4b4967c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-7778d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-7778d0-54f4b4967c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7778d0-54f4b4967c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-7778d0-54f4b4967c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7778d0: serviceaccount "payload-processing-e2e-worker-w0-7778d0" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7778d0: serviceaccount "payload-processing-e2e-worker-w0-7778d0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 1 to 3

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

Created

Container created

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-22gdr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-22gdr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

Created

Container created

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5b7c6c55f6 from 0 to 1
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-5b7c6c55f6

FailedCreate

Error creating: pods "payload-processing-external-model-5b7c6c55f6-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5b7c6c55f6

SuccessfulCreate

Created pod: payload-processing-external-model-5b7c6c55f6-7m6tv

models-as-a-service

multus

payload-processing-external-model-5b7c6c55f6-7m6tv

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5b7c6c55f6-7m6tv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5b7c6c55f6-7m6tv

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5b7c6c55f6-7m6tv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-flbbt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-zp2v6

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-h2zq7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-flbbt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-zp2v6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-pzd8p

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h2zq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-h2zq7

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-flbbt

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-flbbt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h2zq7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pzd8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-pzd8p

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-54b7cc8547 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h2zq7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-flbbt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pzd8p

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pzd8p

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-54b7cc8547

SuccessfulCreate

Created pod: payload-processing-external-model-54b7cc8547-64sbm

models-as-a-service

multus

payload-processing-external-model-54b7cc8547-64sbm

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-54b7cc8547-64sbm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-54b7cc8547-64sbm

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-54b7cc8547-64sbm

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-flbbt

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pzd8p

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pzd8p

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h2zq7

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h2zq7

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-flbbt

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h2zq7

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h2zq7

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-76m8v

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-rpg88

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes
(x2)

models-as-a-service

kubelet

payload-processing-external-model-54b7cc8547-64sbm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-54b7cc8547

SuccessfulDelete

Deleted pod: payload-processing-external-model-54b7cc8547-64sbm

models-as-a-service

kubelet

payload-processing-external-model-54b7cc8547-64sbm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-55bb6bdfd4

SuccessfulCreate

Created pod: payload-processing-external-model-55bb6bdfd4-l5dgm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-76m8v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-54b7cc8547 from 1 to 0

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-76m8v

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-76m8v

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-l5dgm

Created

Container created

models-as-a-service

multus

payload-processing-external-model-55bb6bdfd4-l5dgm

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-l5dgm

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-l5dgm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-76m8v

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-76m8v

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 3 to 6

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

Created

Container created

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-l5dgm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

replicaset-controller

payload-processing-external-model-55bb6bdfd4

SuccessfulDelete

Deleted pod: payload-processing-external-model-55bb6bdfd4-l5dgm

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-55bb6bdfd4 from 1 to 0

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5dfbf6cc9d from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5dfbf6cc9d

SuccessfulCreate

Created pod: payload-processing-external-model-5dfbf6cc9d-sxpft

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-l5dgm

Killing

Stopping container payload-processing

models-as-a-service

multus

payload-processing-external-model-5dfbf6cc9d-sxpft

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5dfbf6cc9d-sxpft

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5dfbf6cc9d-sxpft

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5dfbf6cc9d-sxpft

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

models-as-a-service

kubelet

payload-processing-external-model-5b7c6c55f6-7m6tv

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-280afa1d2683" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5b7c6c55f6

SuccessfulDelete

Deleted pod: payload-processing-external-model-5b7c6c55f6-7m6tv

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5b7c6c55f6 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-5b7c6c55f6-7m6tv

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

Created

Container created

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

Created

Container created

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

Started

Container started

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

Started

Container started

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

Created

Container created

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 2 to 3

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 8 to 10
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

Started

Container started

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

Unhealthy

Startup probe failed: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

ProbeError

Startup probe error: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 6 to 8

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

Started

Container started

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

Unhealthy

Readiness probe failed: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

Unhealthy

Liveness probe failed: Get "https://10.133.0.33:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

ProbeError

Readiness probe error: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

ProbeError

Readiness probe error: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

Unhealthy

Readiness probe failed: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

ProbeError

Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-mt-6b3a29ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6b3a29ec

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-dffz2

ProbeError

Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-mt-6b3a29ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6b3a29ec-openshift-default-5c9596d785 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-dffz2

Unhealthy

Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-mt-6b3a29ec-openshift-default-5c9596d785

SuccessfulCreate

Created pod: e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

Unhealthy

Readiness probe failed: Get "http://10.132.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

Unhealthy

Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

ProbeError

Readiness probe error: Get "http://10.132.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

ProbeError

Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

ProbeError

Readiness probe error: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

Unhealthy

Readiness probe failed: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

Unhealthy

Readiness probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

ProbeError

Readiness probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

Unhealthy

Readiness probe failed: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

ProbeError

Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x12)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes
(x13)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6b3a29ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6b3a29ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6b3a29ec-76cff78f69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6b3a29ec-76cff78f69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6b3a29ec: serviceaccount "payload-processing-e2e-mt-6b3a29ec" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6b3a29ec-76cff78f69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6b3a29ec-76cff78f69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6b3a29ec: serviceaccount "payload-processing-e2e-mt-6b3a29ec" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

Created

Container created

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

Started

Container started
(x5)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

Unhealthy

Readiness probe failed: Get "https://10.133.0.33:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-bvj7j

Unhealthy

Readiness probe failed: Get "https://10.133.0.33:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6b3a29ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6b3a29ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x9)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-qrklv

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qrklv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qrklv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qrklv

Started

Container started
(x10)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-qrklv

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qrklv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qrklv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-84wbs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-55bb6bdfd4 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-55bb6bdfd4

SuccessfulCreate

Created pod: payload-processing-external-model-55bb6bdfd4-xdcbf

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-xdcbf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

Unhealthy

Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

ProbeError

Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

multus

payload-processing-external-model-55bb6bdfd4-xdcbf

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-xdcbf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-xdcbf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5dfbf6cc9d-sxpft

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-55bb6bdfd4-xdcbf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-a-a16786

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a16786

openshift-ingress

deployment-controller

e2e-api-a-a16786-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a16786-openshift-default-7fcd4876c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-a16786-openshift-default-7fcd4876c

SuccessfulCreate

Created pod: e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

openshift-ingress

multus

e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a16786

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a16786-768455c76c from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6b3a29ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6b3a29ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a16786

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a16786-77487b7677 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a16786-768455c76c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a16786-768455c76c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a16786: serviceaccount "payload-processing-e2e-api-a-a16786" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a16786-768455c76c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a16786-768455c76c-scw9s
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a16786-77487b7677

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a16786-77487b7677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a16786: serviceaccount "payload-processing-e2e-api-a-a16786" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a16786-77487b7677

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a16786-77487b7677-frnsn

openshift-ingress

kubelet

payload-processing-e2e-api-a-a16786-77487b7677-frnsn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a16786-768455c76c-scw9s

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-a16786-77487b7677-frnsn

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-a16786-77487b7677-frnsn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-a16786-77487b7677-frnsn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a16786-768455c76c-scw9s

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a16786-768455c76c-scw9s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a16786-768455c76c-scw9s

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-api-a-d4fdeb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d4fdeb

openshift-ingress

deployment-controller

e2e-api-a-d4fdeb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d4fdeb-openshift-default-78966fb9c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-d4fdeb-openshift-default-78966fb9c5

SuccessfulCreate

Created pod: e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

openshift-ingress

multus

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

Started

Container started

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d4fdeb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d4fdeb-75d5585fb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-msmln
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d4fdeb-75d5585fb9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d4fdeb-75d5585fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d4fdeb: serviceaccount "payload-processing-e2e-api-a-d4fdeb" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d4fdeb: serviceaccount "payload-processing-e2e-api-a-d4fdeb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d4fdeb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d4fdeb-75d5585fb9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d4fdeb-75d5585fb9-wnhck

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-msmln

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-msmln

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-msmln

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-d4fdeb-75d5585fb9-wnhck

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-d4fdeb-75d5585fb9-wnhck

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-d4fdeb-75d5585fb9-wnhck

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-d4fdeb-75d5585fb9-wnhck

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-msmln

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

ProbeError

Startup probe error: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

Unhealthy

Startup probe failed: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a16786-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a16786-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-070d07-openshift-default-65f7d87779

SuccessfulCreate

Created pod: e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

openshift-ingress

deployment-controller

e2e-api-b-070d07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-070d07-openshift-default-65f7d87779 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-070d07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-070d07

openshift-ingress

multus

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-070d07-7f49b754c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-070d07-7f49b754c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-070d07: serviceaccount "payload-processing-e2e-api-b-070d07" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-070d07-7f49b754c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-070d07-7f49b754c5-7crbb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-070d07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-070d07-7f49b754c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-070d07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-070d07-6487b76589 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-070d07-6487b76589

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-070d07-6487b76589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-070d07: serviceaccount "payload-processing-e2e-api-b-070d07" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-070d07-6487b76589

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-070d07-6487b76589-zkd5m

openshift-ingress

multus

payload-pre-processing-e2e-api-b-070d07-7f49b754c5-7crbb

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-070d07-7f49b754c5-7crbb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-070d07-6487b76589-zkd5m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-070d07-6487b76589-zkd5m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-070d07-7f49b754c5-7crbb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-070d07-7f49b754c5-7crbb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-070d07-6487b76589-zkd5m

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-070d07-6487b76589-zkd5m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a16786-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a16786-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

test-curl-7199-4079d1

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7199-4079d1

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x2)

openshift-ingress

kubelet

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

Started

Container started

opendatahub

kubelet

test-curl-7199-4079d1

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.262s (1.262s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7199-4079d1

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7199-4079d1

Started

Container started

opendatahub

kubelet

test-curl-7199-4079d1

Killing

Stopping container test-curl-7199-4079d1

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-dd5b85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7 from 2 to 4
(x5)

openshift-ingress

kubelet

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

Created

Container created

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d4fdeb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d4fdeb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-b-2260d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2260d8-openshift-default-6cbd66bf99 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-2260d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2260d8

openshift-ingress

replicaset-controller

e2e-api-b-2260d8-openshift-default-6cbd66bf99

SuccessfulCreate

Created pod: e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

openshift-ingress

replicaset-controller

e2e-api-a-5effde-openshift-default-78c4445cc5

SuccessfulCreate

Created pod: e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

openshift-ingress

gateway_labeler_controller

e2e-api-a-5effde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5effde

openshift-ingress

deployment-controller

e2e-api-a-5effde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5effde-openshift-default-78c4445cc5 from 0 to 1

openshift-ingress

multus

e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d4fdeb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d4fdeb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-cp2fz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-5fhrf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2260d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2260d8-5594b76647 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2260d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2260d8-85d8f74545 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2260d8-5594b76647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2260d8-5594b76647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2260d8: serviceaccount "payload-processing-e2e-api-b-2260d8" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2260d8-85d8f74545

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2260d8-85d8f74545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2260d8: serviceaccount "payload-processing-e2e-api-b-2260d8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2260d8-85d8f74545

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2260d8-85d8f74545-kmhzn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2260d8-5594b76647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2260d8-5594b76647-zrzgn

openshift-ingress

kubelet

payload-processing-e2e-api-b-2260d8-85d8f74545-kmhzn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-2260d8-85d8f74545-kmhzn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2260d8-5594b76647-zrzgn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-2260d8-85d8f74545-kmhzn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2260d8-5594b76647-zrzgn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2260d8-5594b76647-zrzgn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2260d8-5594b76647-zrzgn

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-2260d8-85d8f74545-kmhzn

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5effde-578cb47bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5effde-578cb47bf5-5njq8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5effde-c88b56d97

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5effde-c88b56d97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5effde: serviceaccount "payload-processing-e2e-api-a-5effde" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5effde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5effde-578cb47bf5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5effde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5effde-c88b56d97 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5effde-578cb47bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5effde-578cb47bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5effde: serviceaccount "payload-processing-e2e-api-a-5effde" not found

openshift-ingress

multus

payload-processing-e2e-api-a-5effde-c88b56d97-449fp

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5effde-c88b56d97

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5effde-c88b56d97-449fp

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5effde-578cb47bf5-5njq8

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-5effde-c88b56d97-449fp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-5effde-c88b56d97-449fp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-5effde-c88b56d97-449fp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5effde-578cb47bf5-5njq8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5effde-578cb47bf5-5njq8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5effde-578cb47bf5-5njq8

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5effde-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5effde-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-dd5b85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7 from 4 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-070d07-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-070d07-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

Unhealthy

Startup probe failed: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

ProbeError

Startup probe error: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-070d07-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-070d07-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a16786-768455c76c-scw9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a16786-77487b7677-frnsn

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 10 to 7

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-mkwhw

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-qr9rb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

Unhealthy

Readiness probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xw77g

ProbeError

Readiness probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

Unhealthy

Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2260d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2260d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

ProbeError

Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6b3a29ec: serviceaccount "payload-processing-e2e-mt-6b3a29ec" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6b3a29ec-76cff78f69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6b3a29ec-76cff78f69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6b3a29ec: serviceaccount "payload-processing-e2e-mt-6b3a29ec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6b3a29ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-6xsnb

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6b3a29ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6b3a29ec-76cff78f69 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

openshift-ingress

multus

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-6xsnb

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 7 to 4

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-6xsnb

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-6xsnb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-nf274

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6b3a29ec-76cff78f69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6b3a29ec-76cff78f69-5z7bk

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-6xsnb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-5z7bk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-5z7bk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-6b3a29ec-76cff78f69-5z7bk

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-5z7bk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-4qc6r

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-fpt9z

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kq5hm

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-p87gr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-hwpbp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-kfblf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-lpp5z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2260d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2260d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5effde-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5effde-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-a16786-openshift-default-7fcd4876c-l7zxq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-qvwfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-p7xhl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-rfhls

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-tskqs

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-vlssn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-070d07-7f49b754c5-7crbb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-070d07-6487b76589-zkd5m

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-87af9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-87af9c

openshift-ingress

deployment-controller

e2e-api-b-87af9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-87af9c-openshift-default-85d666bc67 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-87af9c-openshift-default-85d666bc67

SuccessfulCreate

Created pod: e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

openshift-ingress

multus

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d4fdeb-64fb9df46c-msmln

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d4fdeb-75d5585fb9-wnhck

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-070d07-openshift-default-65f7d87779-6qltx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-87af9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-87af9c-789b5d6fb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-87af9c-7bc97665f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-pghvs

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-87af9c-789b5d6fb9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-87af9c-789b5d6fb9-snw9s
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-87af9c-789b5d6fb9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-87af9c-789b5d6fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-87af9c: serviceaccount "payload-processing-e2e-api-b-87af9c" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-87af9c-7bc97665f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-87af9c: serviceaccount "payload-processing-e2e-api-b-87af9c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-87af9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-87af9c-7bc97665f9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-pghvs

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-87af9c-789b5d6fb9-snw9s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-87af9c-789b5d6fb9-snw9s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-pghvs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-pghvs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-pghvs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-87af9c-789b5d6fb9-snw9s

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-87af9c-789b5d6fb9-snw9s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-d4fdeb-openshift-default-78966fb9c5-wcndt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-2260d8-85d8f74545-kmhzn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2260d8-5594b76647-zrzgn

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-5d3f8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-5d3f8a

openshift-ingress

replicaset-controller

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7

SuccessfulCreate

Created pod: e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

openshift-ingress

deployment-controller

e2e-ipp-a-5d3f8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-e1aad0-openshift-default-9dcd96699

SuccessfulCreate

Created pod: e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

openshift-ingress

deployment-controller

e2e-ipp-a-e1aad0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e1aad0-openshift-default-9dcd96699 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e1aad0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e1aad0

openshift-ingress

multus

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5d3f8a: serviceaccount "payload-processing-e2e-ipp-a-5d3f8a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5d3f8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5d3f8a: serviceaccount "payload-processing-e2e-ipp-a-5d3f8a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5d3f8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-t4htn

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-qsdqj

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-t4htn

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-qsdqj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-qsdqj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-qsdqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-qsdqj

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-t4htn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-t4htn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-t4htn

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-d5dfx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-hrkn7

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-tnqm7

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e1aad0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zzfd9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-xqpcr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-7jcnf
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e1aad0: serviceaccount "payload-processing-e2e-ipp-a-e1aad0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e1aad0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-fbhj4
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e1aad0: serviceaccount "payload-processing-e2e-ipp-a-e1aad0" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-fbhj4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-fbhj4

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-fbhj4

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-7jcnf

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-fbhj4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-7jcnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-7jcnf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-7jcnf

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-6b3a29ec-openshift-default-5c9596d785

SuccessfulCreate

Created pod: e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

openshift-ingress

replicaset-controller

e2e-mt-6b3a29ec-openshift-default-5c9596d785

SuccessfulCreate

Created pod: e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

openshift-ingress

replicaset-controller

e2e-mt-6b3a29ec-openshift-default-5c9596d785

SuccessfulCreate

Created pod: e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

openshift-ingress

deployment-controller

e2e-mt-6b3a29ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6b3a29ec-openshift-default-5c9596d785 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6b3a29ec-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

Created

Container created

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

Started

Container started

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

Started

Container started

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

Created

Container created

openshift-ingress

multus

e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7199-8f517a

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7199-8f517a

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

Created

Container created

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

Started

Container started

opendatahub

kubelet

test-curl-7199-8f517a

Created

Container created

opendatahub

kubelet

test-curl-7199-8f517a

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 5.589s (5.589s including waiting). Image size: 106100986 bytes.
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

opendatahub

kubelet

test-curl-7199-8f517a

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

Unhealthy

Readiness probe failed: Get "http://10.132.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

ProbeError

Readiness probe error: Get "http://10.132.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

ProbeError

Startup probe error: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

Unhealthy

Startup probe failed: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused

opendatahub

kubelet

test-curl-7199-8f517a

Killing

Stopping container test-curl-7199-8f517a
(x2)

openshift-ingress

kubelet

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

Started

Container started

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-mt-6b3a29ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6b3a29ec-openshift-default-5c9596d785 from 4 to 7

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6b3a29ec-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

replicaset-controller

e2e-mt-6b3a29ec-openshift-default-5c9596d785

SuccessfulCreate

Created pod: e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

Created

Container created

openshift-ingress

replicaset-controller

e2e-mt-6b3a29ec-openshift-default-5c9596d785

SuccessfulCreate

Created pod: e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

openshift-ingress

replicaset-controller

e2e-mt-6b3a29ec-openshift-default-5c9596d785

SuccessfulCreate

Created pod: e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

openshift-ingress

multus

e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

Created

Container created

openshift-ingress

multus

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

Started

Container started

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

Created

Container created

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-87af9c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-87af9c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-2260d8-openshift-default-6cbd66bf99-22j9z

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-8b4030-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8b4030-openshift-default-654d8bb565 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-8b4030-openshift-default-654d8bb565

SuccessfulCreate

Created pod: e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8b4030

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8b4030

openshift-ingress

multus

e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8b4030

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8b4030-64c6b97d5f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8b4030: serviceaccount "payload-processing-e2e-ipp-a-8b4030" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8b4030

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8b4030-64c6b97d5f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8b4030: serviceaccount "payload-processing-e2e-ipp-a-8b4030" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-4cmbx

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8b4030-64c6b97d5f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-l7tkw

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-l7tkw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-l7tkw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-l7tkw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-l7tkw

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-4cmbx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-4cmbx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-4cmbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-4cmbx

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-87af9c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-87af9c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-mt-6b3a29ec-76cff78f69-5z7bk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6b3a29ec-d9f5dbbc-6xsnb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5effde-578cb47bf5-5njq8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5effde-c88b56d97-449fp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

ProbeError

Readiness probe error: Get "http://10.132.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

Unhealthy

Readiness probe failed: Get "http://10.132.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-e1aad0-openshift-default-9dcd96699

SuccessfulCreate

Created pod: e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e1aad0-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-e1aad0-openshift-default-9dcd96699

SuccessfulCreate

Created pod: e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

openshift-ingress

deployment-controller

e2e-ipp-a-e1aad0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e1aad0-openshift-default-9dcd96699 from 1 to 4

openshift-ingress

replicaset-controller

e2e-ipp-a-e1aad0-openshift-default-9dcd96699

SuccessfulCreate

Created pod: e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

Started

Container started

openshift-ingress

multus

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

Started

Container started

openshift-ingress

multus

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

ProbeError

Startup probe error: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

Unhealthy

Startup probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

ProbeError

Startup probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

Unhealthy

Startup probe failed: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5d3f8a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5d3f8a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-5effde-openshift-default-78c4445cc5-6l5w4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-87af9c-789b5d6fb9-snw9s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-87af9c-7bc97665f9-pghvs

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e1aad0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e1aad0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65

SuccessfulCreate

Created pod: e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

openshift-ingress

deployment-controller

e2e-ipp-b-18d5f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-18d5f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-18d5f6

openshift-ingress

multus

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-545bf9dc9-qsdqj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5767b6cb87-t4htn

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5d3964

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5d3964

openshift-ingress

replicaset-controller

e2e-ipp-b-5d3964-openshift-default-6646dbc887

SuccessfulCreate

Created pod: e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

openshift-ingress

deployment-controller

e2e-ipp-b-5d3964-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5d3964-openshift-default-6646dbc887 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5d3f8a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5d3f8a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1aad0-5b759cbf8c-7jcnf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-87af9c-openshift-default-85d666bc67-p799k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1aad0-7b7c9cb8b9-fbhj4

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69

SuccessfulCreate

Created pod: e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

openshift-ingress

deployment-controller

e2e-ipp-a-a32cdb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a32cdb-openshift-default-677f4f8d69 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a32cdb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a32cdb

openshift-ingress

multus

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

Unhealthy

Startup probe failed: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

ProbeError

Startup probe error: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-18d5f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-18d5f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-18d5f6-cc56d555 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-hmbfh

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-18d5f6-cc56d555

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-18d5f6-cc56d555-bspdn
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-18d5f6-cc56d555

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-18d5f6-cc56d555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-18d5f6: serviceaccount "payload-processing-e2e-ipp-b-18d5f6" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-18d5f6: serviceaccount "payload-processing-e2e-ipp-b-18d5f6" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-18d5f6-cc56d555-bspdn

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-hmbfh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-hmbfh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-hmbfh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18d5f6-cc56d555-bspdn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18d5f6-cc56d555-bspdn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18d5f6-cc56d555-bspdn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-hmbfh

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-bp9q8
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5d3964: serviceaccount "payload-processing-e2e-ipp-b-5d3964" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5d3964

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5d3964

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5d3964-5566fb7949 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5d3964-5566fb7949

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5d3964-5566fb7949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5d3964: serviceaccount "payload-processing-e2e-ipp-b-5d3964" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-bp9q8

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5d3964-5566fb7949

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5d3964-5566fb7949-kpzrh

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d3964-5566fb7949-kpzrh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-bp9q8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-bp9q8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-bp9q8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-5d3964-5566fb7949-kpzrh

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d3964-5566fb7949-kpzrh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d3964-5566fb7949-kpzrh

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a32cdb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a32cdb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a32cdb: serviceaccount "payload-processing-e2e-ipp-a-a32cdb" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8b4030-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8b4030-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-fs9dl

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-mfnpk
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a32cdb: serviceaccount "payload-processing-e2e-ipp-a-a32cdb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-fs9dl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-fs9dl

openshift-ingress

multus

payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-mfnpk

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-mfnpk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-mfnpk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-mfnpk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-fs9dl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-fs9dl

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xpsrs

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8b4030-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8b4030-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-64c6b97d5f-l7tkw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b4030-f4c5f9f47-4cmbx

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5d3f8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5d3f8a-546658988d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5d3f8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5d3f8a: serviceaccount "payload-processing-e2e-ipp-a-5d3f8a" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5d3f8a-546658988d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5d3f8a-546658988d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5d3f8a: serviceaccount "payload-processing-e2e-ipp-a-5d3f8a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5d3f8a-546658988d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.545s (2.545s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.082s (3.082s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e1aad0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e1aad0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e1aad0-557979479d from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e1aad0-557979479d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e1aad0-557979479d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e1aad0: serviceaccount "payload-processing-e2e-ipp-a-e1aad0" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e1aad0: serviceaccount "payload-processing-e2e-ipp-a-e1aad0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e1aad0-557979479d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e1aad0-557979479d-49tzc

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-x4whz

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-scjzt

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-x4whz

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-x4whz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-x4whz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-x4whz

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-dd5b85-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7 from 6 to 4

openshift-ingress

multus

payload-processing-e2e-ipp-a-e1aad0-557979479d-49tzc

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1aad0-557979479d-49tzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1aad0-557979479d-49tzc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1aad0-557979479d-49tzc

Created

Container created

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-lf64b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bd9w6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-45k6s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-wgzpn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-nkdvh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bw2lt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6b3a29ec-openshift-default-5c9596d785-bdspv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-329d79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-329d79

openshift-ingress

deployment-controller

e2e-api-a-329d79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-329d79-openshift-default-575867c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-329d79-openshift-default-575867c7

SuccessfulCreate

Created pod: e2e-api-a-329d79-openshift-default-575867c7-zmd79

openshift-ingress

multus

e2e-api-a-329d79-openshift-default-575867c7-zmd79

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-lsqtm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-329d79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-329d79-5b55f4444c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-329d79-5b55f4444c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-329d79-5b55f4444c-xm7lp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-329d79-5b55f4444c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-329d79-5b55f4444c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-329d79: serviceaccount "payload-processing-e2e-api-a-329d79" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-329d79-948cb787f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-329d79-948cb787f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-329d79: serviceaccount "payload-processing-e2e-api-a-329d79" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-329d79-948cb787f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-329d79-948cb787f-kdr5w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-329d79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-329d79-948cb787f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-329d79-5b55f4444c-xm7lp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-329d79-5b55f4444c-xm7lp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-329d79-948cb787f-kdr5w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-329d79-948cb787f-kdr5w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-329d79-948cb787f-kdr5w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-329d79-948cb787f-kdr5w

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-329d79-5b55f4444c-xm7lp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-329d79-5b55f4444c-xm7lp

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-18d5f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-18d5f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-prtgn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 5 to 3

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qz8k9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-j8gl2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8b4030

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8b4030-fcbf99c6d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8b4030

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8b4030-554877f44c from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8b4030-554877f44c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8b4030: serviceaccount "payload-processing-e2e-ipp-a-8b4030" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8b4030: serviceaccount "payload-processing-e2e-ipp-a-8b4030" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8b4030-554877f44c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-j6g99

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-18d5f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-j6g99

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-j6g99

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-j6g99

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-18d5f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-j6g99

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.146s (2.146s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-ddsxd
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a32cdb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a32cdb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c35264

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c35264

openshift-ingress

multus

e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-c35264-openshift-default-6cf7474567

SuccessfulCreate

Created pod: e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

openshift-ingress

deployment-controller

e2e-ipp-b-c35264-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c35264-openshift-default-6cf7474567 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a32cdb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a32cdb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c35264

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c35264

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c35264-74c6497b4f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c35264: serviceaccount "payload-processing-e2e-ipp-b-c35264" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-pjvnw

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-pjvnw

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18d5f6-cc56d555-bspdn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-pjvnw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c35264-74c6497b4f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c35264-74c6497b4f-wmc9m
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c35264-74c6497b4f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c35264-74c6497b4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c35264: serviceaccount "payload-processing-e2e-ipp-b-c35264" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c35264-74c6497b4f-wmc9m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-c35264-74c6497b4f-wmc9m

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c35264-74c6497b4f-wmc9m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c35264-74c6497b4f-wmc9m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18d5f6-6fdff4bcf-hmbfh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-pjvnw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-pjvnw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 5 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d3964-7c75f7b9b7-bp9q8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d3964-5566fb7949-kpzrh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zw2ww

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

ProbeError

Readiness probe error: Get "http://10.132.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-pl5mj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

Unhealthy

Readiness probe failed: Get "http://10.132.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-h2zq7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h2zq7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-rpg88

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a32cdb-855c78f44c-fs9dl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a32cdb-7d7b895cc5-mfnpk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-329d79-openshift-default-575867c7-zmd79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-329d79-openshift-default-575867c7-zmd79

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-rpg88

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-329d79-openshift-default-575867c7-zmd79

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-329d79-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-329d79-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-329d79-openshift-default-575867c7-zmd79

ProbeError

Startup probe error: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-329d79-openshift-default-575867c7-zmd79

Unhealthy

Startup probe failed: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5d3964-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5d3964-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5d3f8a-546658988d-4msn4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5d3f8a-5fcd98d775-rb9n9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1aad0-557979479d-49tzc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1aad0-6f9d5fd4c9-x4whz

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-18d5f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-18d5f6-59796c8dc6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-18d5f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-18d5f6: serviceaccount "payload-processing-e2e-ipp-b-18d5f6" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-18d5f6-59796c8dc6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-18d5f6: serviceaccount "payload-processing-e2e-ipp-b-18d5f6" not found

openshift-ingress

kubelet

e2e-ipp-a-5d3f8a-openshift-default-ff5c48f7-5wtgb

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-329d79-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-64nnl
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-329d79-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-64nnl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-64nnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-hxt9c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-64nnl

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-18d5f6-59796c8dc6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-hxt9c

openshift-ingress

multus

payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-hxt9c

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-64nnl

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-hxt9c

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-hxt9c

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-r49pb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-sl8fr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-w48vf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-e1aad0-openshift-default-9dcd96699-8g8hm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5d3964-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5d3964-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-b-7a7f22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7a7f22

openshift-ingress

replicaset-controller

e2e-api-b-7a7f22-openshift-default-5d767fffb9

SuccessfulCreate

Created pod: e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

openshift-ingress

deployment-controller

e2e-api-b-7a7f22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7a7f22-openshift-default-5d767fffb9 from 0 to 1

openshift-ingress

multus

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7a7f22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7a7f22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7a7f22-cd757844c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7a7f22-cd757844c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7a7f22-cd757844c-4txtc
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7a7f22: serviceaccount "payload-processing-e2e-api-b-7a7f22" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7a7f22-cd757844c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7a7f22-cd757844c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7a7f22: serviceaccount "payload-processing-e2e-api-b-7a7f22" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-9hfcq

openshift-ingress

multus

payload-processing-e2e-api-b-7a7f22-cd757844c-4txtc

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7a7f22-cd757844c-4txtc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-9hfcq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-9hfcq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-9hfcq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-7a7f22-cd757844c-4txtc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-7a7f22-cd757844c-4txtc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-9hfcq

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a32cdb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a32cdb: serviceaccount "payload-processing-e2e-ipp-a-a32cdb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a32cdb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a32cdb: serviceaccount "payload-processing-e2e-ipp-a-a32cdb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-qgjfv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-qgjfv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-qgjfv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-qgjfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-kwxpq

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-qgjfv

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-kwxpq

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-kwxpq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-kwxpq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-kwxpq

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-5d3964-openshift-default-6646dbc887-t68nq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-praxis-a-da5481-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-da5481-openshift-default-84c5f4d769 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-da5481

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-da5481

openshift-ingress

replicaset-controller

e2e-praxis-a-da5481-openshift-default-84c5f4d769

SuccessfulCreate

Created pod: e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

openshift-ingress

multus

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-da5481

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-da5481-84569569df from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-da5481: serviceaccount "payload-processing-e2e-praxis-a-da5481" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-p4rbk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-da5481

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-da5481-84569569df

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-da5481-84569569df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-da5481: serviceaccount "payload-processing-e2e-praxis-a-da5481" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-da5481-84569569df

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-da5481-84569569df-g4kvp

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c561e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c561e3

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-p4rbk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-da5481-84569569df-g4kvp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-p4rbk

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-c561e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c561e3-openshift-default-6c69b648c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-da5481-84569569df-g4kvp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-p4rbk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-da5481-84569569df-g4kvp

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-b-c561e3-openshift-default-6c69b648c9

SuccessfulCreate

Created pod: e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

openshift-ingress

multus

payload-processing-e2e-praxis-a-da5481-84569569df-g4kvp

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-p4rbk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c561e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c561e3-645dc66449 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c561e3-645dc66449

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c561e3-645dc66449-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c561e3: serviceaccount "payload-processing-e2e-ipp-b-c561e3" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c561e3-779c466475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c561e3-779c466475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c561e3: serviceaccount "payload-processing-e2e-ipp-b-c561e3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c561e3-779c466475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c561e3-779c466475-q8hdr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c561e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c561e3-779c466475 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c561e3-645dc66449

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c561e3-645dc66449-jzksj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c561e3-779c466475-q8hdr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c561e3-779c466475-q8hdr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c561e3-779c466475-q8hdr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c561e3-779c466475-q8hdr

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c561e3-645dc66449-jzksj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-c561e3-645dc66449-jzksj

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c561e3-645dc66449-jzksj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c561e3-645dc66449-jzksj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18d5f6-75c58d7fc9-64nnl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18d5f6-59796c8dc6-hxt9c

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c35264-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c35264-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-18d5f6-openshift-default-5d69c6bd65-8m2xs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5

SuccessfulCreate

Created pod: e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-6f9fd2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-6f9fd2

openshift-ingress

deployment-controller

e2e-praxis-a-6f9fd2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c35264-74c6497b4f-wmc9m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c35264-648bf5c4c-pjvnw

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c561e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c561e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6f9fd2: serviceaccount "payload-processing-e2e-praxis-a-6f9fd2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-6f9fd2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-6f9fd2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6f9fd2: serviceaccount "payload-processing-e2e-praxis-a-6f9fd2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-l2lj8

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-zd5vb

openshift-ingress

multus

payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-zd5vb

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-l2lj8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-l2lj8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-l2lj8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-l2lj8

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-zd5vb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-zd5vb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-zd5vb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c35264-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c35264-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

Started

Container started

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

Unhealthy

Readiness probe failed: Get "http://10.132.0.204:15021/healthz/ready": read tcp 10.132.0.2:39050->10.132.0.204:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

ProbeError

Readiness probe error: Get "http://10.132.0.204:15021/healthz/ready": read tcp 10.132.0.2:39050->10.132.0.204:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b4030-554877f44c-j6g99

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b4030-fcbf99c6d-jtxq4

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7a7f22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-8b4030-openshift-default-654d8bb565-tclsk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7a7f22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

ProbeError

Readiness probe error: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

Unhealthy

Readiness probe failed: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c35264

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c35264-5f6b77cf46 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-flbbt
(x2)

openshift-ingress

kubelet

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c35264

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-76m8v

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 8 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-76m8v

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-flbbt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-76m8v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-76m8v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c35264-5f6b77cf46

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c35264-5f6b77cf46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c35264: serviceaccount "payload-processing-e2e-ipp-b-c35264" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-jkkf6
(x2)

openshift-ingress

kubelet

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

Created

Container created
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c35264: serviceaccount "payload-processing-e2e-ipp-b-c35264" not found
(x2)

openshift-ingress

kubelet

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-jkkf6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-flbbt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-jkkf6

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-flbbt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c35264-5f6b77cf46

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c35264-5f6b77cf46-zgnmc

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-jkkf6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-jkkf6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-c35264-5f6b77cf46-zgnmc

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c35264-5f6b77cf46-zgnmc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c35264-5f6b77cf46-zgnmc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c35264-5f6b77cf46-zgnmc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7a7f22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7a7f22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-xffcm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-dd5b85-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-w5hkc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-da5481-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-da5481-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-da5481-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-da5481-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-329d79-5b55f4444c-xm7lp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-329d79-948cb787f-kdr5w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

ProbeError

Readiness probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

Unhealthy

Readiness probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-dd5b85-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7 from 3 to 2
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-dffz2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-cw5nj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-pflrt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 6 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-dffz2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-m2mtg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pflrt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

Unhealthy

Startup probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

ProbeError

Startup probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-mwcs2

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-7j85f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-03d737

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-03d737

openshift-ingress

multus

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-03d737-openshift-default-599d9589d5

SuccessfulCreate

Created pod: e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

openshift-ingress

deployment-controller

e2e-praxis-b-03d737-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-03d737-openshift-default-599d9589d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c35264-6df6cb7487-jkkf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c35264-5f6b77cf46-zgnmc

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-03d737

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-03d737-7b9f454cf7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-03d737

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-ft2ch
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-03d737: serviceaccount "payload-processing-e2e-praxis-b-03d737" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-03d737-7b9f454cf7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-03d737-7b9f454cf7-b6x5x
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-03d737-7b9f454cf7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-03d737-7b9f454cf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-03d737: serviceaccount "payload-processing-e2e-praxis-b-03d737" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-03d737-7b9f454cf7-b6x5x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-03d737-7b9f454cf7-b6x5x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-ft2ch

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-ft2ch

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-ft2ch

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-03d737-7b9f454cf7-b6x5x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c561e3-779c466475-q8hdr

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-praxis-b-03d737-7b9f454cf7-b6x5x

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c561e3-645dc66449-jzksj

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-ft2ch

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6f9fd2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6f9fd2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-329d79-openshift-default-575867c7-zmd79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-c35264-openshift-default-6cf7474567-6wrhs

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc

SuccessfulCreate

Created pod: e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-dab9ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-dab9ee

openshift-ingress

deployment-controller

e2e-praxis-a-dab9ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc from 0 to 1
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c561e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c561e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-7a7f22-cd757844c-4txtc

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-d22078-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-d22078-openshift-default-5cf4bf8985 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-d22078-openshift-default-5cf4bf8985

SuccessfulCreate

Created pod: e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-d22078

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-d22078

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7a7f22-78dfd4645f-9hfcq

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-dab9ee: serviceaccount "payload-processing-e2e-praxis-a-dab9ee" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-dab9ee-6d996d455

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-dab9ee-6d996d455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-dab9ee: serviceaccount "payload-processing-e2e-praxis-a-dab9ee" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-dab9ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-dab9ee-6d996d455 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-dab9ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-rphxz

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-dab9ee-6d996d455

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-dab9ee-6d996d455-8lcdf

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dab9ee-6d996d455-8lcdf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dab9ee-6d996d455-8lcdf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dab9ee-6d996d455-8lcdf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-rphxz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-rphxz

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-dab9ee-6d996d455-8lcdf

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-rphxz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-rphxz

Started

Container started

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-14600f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-14600f

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-7a7f22-openshift-default-5d767fffb9-szvkp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ipp-a-14600f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-14600f-openshift-default-56585bb4b9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-d22078

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-d22078

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-d22078-5c45ddbf8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d22078: serviceaccount "payload-processing-e2e-praxis-b-d22078" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d22078-5c45ddbf8c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d22078: serviceaccount "payload-processing-e2e-praxis-b-d22078" not found

openshift-ingress

replicaset-controller

e2e-ipp-a-14600f-openshift-default-56585bb4b9

SuccessfulCreate

Created pod: e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-p46xh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d22078-5c45ddbf8c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-56t42

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-p46xh

openshift-ingress

multus

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-56t42

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-p46xh

AddedInterface

Add eth0 [10.132.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-p46xh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-p46xh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-56t42

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-56t42

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-56t42

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-14600f-5f4b947575

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-14600f-5f4b947575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-14600f: serviceaccount "payload-processing-e2e-ipp-a-14600f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-14600f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-14600f-8678955c47 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-14600f-8678955c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-14600f-8678955c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-14600f: serviceaccount "payload-processing-e2e-ipp-a-14600f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-14600f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-14600f-5f4b947575 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-14600f-5f4b947575-g4l68

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-14600f-5f4b947575-g4l68

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-14600f-5f4b947575-g4l68

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-14600f-5f4b947575-g4l68

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-14600f-5f4b947575

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-14600f-5f4b947575-g4l68

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-14600f-8678955c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-14600f-8678955c47-dnf7c

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-14600f-8678955c47-dnf7c

AddedInterface

Add eth0 [10.132.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-14600f-8678955c47-dnf7c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-14600f-8678955c47-dnf7c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-14600f-8678955c47-dnf7c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c561e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c561e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c561e3: serviceaccount "payload-processing-e2e-ipp-b-c561e3" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c561e3: serviceaccount "payload-processing-e2e-ipp-b-c561e3" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-bfjm2

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-bfjm2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-bfjm2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-gs7pb

openshift-ingress

multus

payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-gs7pb

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-14600f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-14600f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-bfjm2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-bfjm2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-gs7pb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-gs7pb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-gs7pb

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

ProbeError

Readiness probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

Unhealthy

Readiness probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-03d737-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-03d737-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

ProbeError

Startup probe error: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

Unhealthy

Startup probe failed: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-03d737-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-03d737-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

ProbeError

Readiness probe error: Get "http://10.132.0.224:15021/healthz/ready": read tcp 10.132.0.2:48818->10.132.0.224:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

Unhealthy

Readiness probe failed: Get "http://10.132.0.224:15021/healthz/ready": read tcp 10.132.0.2:48818->10.132.0.224:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

ProbeError

Startup probe error: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

Unhealthy

Startup probe failed: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-da5481-58cf8d7c8c-p4rbk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-da5481-84569569df-g4kvp

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dab9ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dab9ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-14600f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-14600f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d22078-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d22078-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-b-fc85c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-fc85c7-openshift-default-7bdf484f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7

SuccessfulCreate

Created pod: e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-fc85c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-fc85c7

openshift-ingress

multus

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-fc85c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-fc85c7-5bd95745d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-fc85c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-fc85c7-5bd95745d5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-kfsj2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-fc85c7-5bd95745d5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-fc85c7: serviceaccount "payload-processing-e2e-praxis-b-fc85c7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-5jwhp
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-fc85c7: serviceaccount "payload-processing-e2e-praxis-b-fc85c7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-5jwhp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-kfsj2

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-5jwhp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-kfsj2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-5jwhp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-kfsj2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-5jwhp

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-kfsj2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6f9fd2-7cd564cf57-zd5vb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6f9fd2-648ddf94c-l2lj8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-14600f-5f4b947575-g4l68

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-14600f-8678955c47-dnf7c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-da5481-openshift-default-84c5f4d769-bfzl6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-03d737-697d54c9cf-ft2ch

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-03d737-7b9f454cf7-b6x5x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-62pht

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5

FailedCreate

Error creating: pods "e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5-" is forbidden: error looking up service account openshift-ingress/e2e-praxis-a-6f9fd2-openshift-default: serviceaccount "e2e-praxis-a-6f9fd2-openshift-default" not found

openshift-ingress

deployment-controller

e2e-praxis-a-6f9fd2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-6f9fd2-openshift-default-7cf55db6b5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d22078-5c45ddbf8c-56t42

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d22078-7c749c7b4c-p46xh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a32cdb-6695c6bf6d-kwxpq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a32cdb-b45ffb8cf-qgjfv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-d22078-openshift-default-5cf4bf8985-f66l5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-a32cdb-openshift-default-677f4f8d69-p46kt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-14600f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-14600f-5f64db76dd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-14600f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-14600f-79c884495f from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-14600f-79c884495f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-14600f-79c884495f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-14600f: serviceaccount "payload-processing-e2e-ipp-a-14600f" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-14600f-5f64db76dd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-14600f-5f64db76dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-14600f: serviceaccount "payload-processing-e2e-ipp-a-14600f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-14600f-79c884495f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-14600f-79c884495f-zj52s

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-14600f-79c884495f-zj52s

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-14600f-5f64db76dd-hqbfz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-14600f-5f64db76dd-hqbfz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-14600f-5f64db76dd-hqbfz

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-14600f-79c884495f-zj52s

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-14600f-5f64db76dd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-14600f-5f64db76dd-hqbfz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-14600f-79c884495f-zj52s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-14600f-79c884495f-zj52s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-14600f-5f64db76dd-hqbfz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ca15df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ca15df

openshift-ingress

deployment-controller

e2e-ipp-b-ca15df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ca15df-openshift-default-5bc6987489 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-ca15df-openshift-default-5bc6987489

SuccessfulCreate

Created pod: e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c561e3-c7bcdfc7d-gs7pb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c561e3-647fb7855f-bfjm2

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ca15df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ca15df-54c955d64c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-v8fq4

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca15df-54c955d64c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ca15df-54c955d64c-lh7nm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca15df: serviceaccount "payload-processing-e2e-ipp-b-ca15df" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-v8fq4

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ca15df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca15df-54c955d64c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ca15df-54c955d64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca15df: serviceaccount "payload-processing-e2e-ipp-b-ca15df" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-v8fq4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca15df-54c955d64c-lh7nm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-v8fq4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca15df-54c955d64c-lh7nm

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-ca15df-54c955d64c-lh7nm

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-v8fq4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca15df-54c955d64c-lh7nm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-03d737-openshift-default-599d9589d5-gbd9n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-c561e3-openshift-default-6c69b648c9-mgkr7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-de2877

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-de2877

openshift-ingress

deployment-controller

e2e-praxis-a-de2877-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-de2877-openshift-default-b9fbff7d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-de2877-openshift-default-b9fbff7d9

SuccessfulCreate

Created pod: e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

openshift-ingress

multus

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

AddedInterface

Add eth0 [10.132.0.246/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-de2877

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-de2877

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-de2877-b45b7ff7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-thrn7

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-de2877-b45b7ff7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-de2877-b45b7ff7-lqwp8

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-thrn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-de2877-b45b7ff7-lqwp8

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-de2877-b45b7ff7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-de2877-b45b7ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-de2877: serviceaccount "payload-processing-e2e-praxis-a-de2877" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-thrn7
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-de2877: serviceaccount "payload-processing-e2e-praxis-a-de2877" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-thrn7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-de2877-b45b7ff7-lqwp8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-thrn7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-de2877-b45b7ff7-lqwp8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-de2877-b45b7ff7-lqwp8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fc85c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fc85c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

ProbeError

Startup probe error: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

Unhealthy

Startup probe failed: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dab9ee-697b86b4cf-rphxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dab9ee-6d996d455-8lcdf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-zp2v6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-zp2v6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

Started

Container started

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fc85c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fc85c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

ProbeError

Readiness probe error: Get "http://10.132.0.242:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

Unhealthy

Readiness probe failed: Get "http://10.132.0.242:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

Unhealthy

Startup probe failed: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

ProbeError

Startup probe error: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulDelete

Deleted pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-qfkj4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-phq4n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

ProbeError

Startup probe error: Get "http://10.132.0.242:15021/healthz/ready": dial tcp 10.132.0.242:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dab9ee-openshift-default

FailedUpdateStatus

horizontalpodautoscalers.autoscaling "e2e-praxis-a-dab9ee-openshift-default" not found
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

Unhealthy

Startup probe failed: Get "http://10.132.0.242:15021/healthz/ready": dial tcp 10.132.0.242:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dab9ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dab9ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-dab9ee-openshift-default-744bfd9ffc-vpf8k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-qrklv

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qrklv

Killing

Stopping container discovery

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ca15df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ca15df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-sjq55

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc85c7-7996b7c78c-5jwhp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fc85c7-5bd95745d5-kfsj2

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

ProbeError

Readiness probe error: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

Unhealthy

Readiness probe failed: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

ProbeError

Startup probe error: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

Unhealthy

Startup probe failed: Get "http://10.132.0.246:15021/healthz/ready": dial tcp 10.132.0.246:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca15df-6bb76ffd95-v8fq4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca15df-54c955d64c-lh7nm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ca15df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ca15df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

AddedInterface

Add eth0 [10.132.1.5/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

ProbeError

Startup probe error: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

Unhealthy

Startup probe failed: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

ProbeError

Startup probe error: Get "http://10.132.1.5:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

Unhealthy

Startup probe failed: Get "http://10.132.1.5:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

Started

Container started

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-de2877-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-de2877-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-e2f0bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-e2f0bd

openshift-ingress

replicaset-controller

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85

SuccessfulCreate

Created pod: e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

openshift-ingress

deployment-controller

e2e-praxis-b-e2f0bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-e2f0bd-openshift-default-746bc78f85 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-fc85c7-openshift-default-7bdf484f7-zjhcq

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-e2f0bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e2f0bd: serviceaccount "payload-processing-e2e-praxis-b-e2f0bd" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e2f0bd: serviceaccount "payload-processing-e2e-praxis-b-e2f0bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-kzhcz

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-e2f0bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-jqjpt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-jqjpt

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-jqjpt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-jqjpt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-jqjpt

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-kzhcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-kzhcz

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-kzhcz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-kzhcz

Created

Container created

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 4 to 5

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

AddedInterface

Add eth0 [10.132.1.12/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

Unhealthy

Startup probe failed: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

ProbeError

Startup probe error: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

ProbeError

Startup probe error: Get "http://10.132.1.12:15021/healthz/ready": dial tcp 10.132.1.12:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

Unhealthy

Startup probe failed: Get "http://10.132.1.12:15021/healthz/ready": dial tcp 10.132.1.12:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ca15df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ca15df-598f689fdd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ca15df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-7sr7p
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca15df: serviceaccount "payload-processing-e2e-ipp-b-ca15df" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca15df-598f689fdd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ca15df-598f689fdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca15df: serviceaccount "payload-processing-e2e-ipp-b-ca15df" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-7sr7p

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-7sr7p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-7sr7p

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca15df-598f689fdd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ca15df-598f689fdd-dt47z

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-7sr7p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca15df-598f689fdd-dt47z

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-ca15df-598f689fdd-dt47z

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca15df-598f689fdd-dt47z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca15df-598f689fdd-dt47z

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459

SuccessfulCreate

Created pod: e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

openshift-ingress

deployment-controller

e2e-shared-a-w2-2339ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-2339ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-2339ed

openshift-ingress

multus

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes
(x3)

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 1 to 3

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-93f411

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-93f411

openshift-ingress

replicaset-controller

e2e-shared-a-w4-93f411-openshift-default-554df87979

SuccessfulCreate

Created pod: e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

openshift-ingress

deployment-controller

e2e-shared-a-w4-93f411-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-93f411-openshift-default-554df87979 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

openshift-ingress

multus

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

Created

Container created

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

AddedInterface

Add eth0 [10.132.1.19/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-2339ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2339ed: serviceaccount "payload-processing-e2e-shared-a-w2-2339ed" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2339ed: serviceaccount "payload-processing-e2e-shared-a-w2-2339ed" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-2339ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9

AddedInterface

Add eth0 [10.132.1.20/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

ProbeError

Startup probe error: Get "http://10.132.1.19:15021/healthz/ready": dial tcp 10.132.1.19:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

Unhealthy

Startup probe failed: Get "http://10.132.1.19:15021/healthz/ready": dial tcp 10.132.1.19:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-93f411

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-93f411-8549bb767c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-93f411

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-93f411: serviceaccount "payload-processing-e2e-shared-a-w4-93f411" not found

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

ProbeError

Startup probe error: Get "http://10.132.1.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

Unhealthy

Startup probe failed: Get "http://10.132.1.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-93f411-8549bb767c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-93f411-8549bb767c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-93f411: serviceaccount "payload-processing-e2e-shared-a-w4-93f411" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-93f411-8549bb767c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulCreate

Created pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

Started

Container started

openshift-ingress

multus

e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

AddedInterface

Add eth0 [10.132.1.22/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

Created

Container created

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

AddedInterface

Add eth0 [10.132.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

ProbeError

Startup probe error: Get "http://10.132.1.22:15021/healthz/ready": dial tcp 10.132.1.22:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

Unhealthy

Startup probe failed: Get "http://10.132.1.22:15021/healthz/ready": dial tcp 10.132.1.22:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-861dfd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-861dfd

openshift-ingress

replicaset-controller

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955

SuccessfulCreate

Created pod: e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

openshift-ingress

deployment-controller

e2e-shared-a-w1-861dfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-861dfd-openshift-default-7674fcd955 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

Unhealthy

Startup probe failed: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

ProbeError

Startup probe error: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-861dfd: serviceaccount "payload-processing-e2e-shared-a-w1-861dfd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-861dfd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-861dfd: serviceaccount "payload-processing-e2e-shared-a-w1-861dfd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-861dfd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx

AddedInterface

Add eth0 [10.132.1.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-14600f-79c884495f-zj52s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-14600f-5f64db76dd-hqbfz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-14600f-openshift-default-56585bb4b9-jt97p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e2f0bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e2f0bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-93f411-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-93f411-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

Unhealthy

Startup probe failed: Get "http://10.132.1.18:15021/healthz/ready": dial tcp 10.132.1.18:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

ProbeError

Startup probe error: Get "http://10.132.1.18:15021/healthz/ready": dial tcp 10.132.1.18:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-de2877-b45b7ff7-lqwp8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-de2877-67559ffdb7-thrn7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca15df-598f689fdd-dt47z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca15df-5d7b6466bc-7sr7p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-ca15df-openshift-default-5bc6987489-zhkm6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-ab9b62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ab9b62-openshift-default-59c8cbd769 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769

SuccessfulCreate

Created pod: e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ab9b62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ab9b62

openshift-ingress

multus

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

AddedInterface

Add eth0 [10.132.1.28/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-93f411-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-93f411-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ab9b62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ab9b62: serviceaccount "payload-processing-e2e-praxis-a-ab9b62" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ab9b62: serviceaccount "payload-processing-e2e-praxis-a-ab9b62" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ab9b62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44

AddedInterface

Add eth0 [10.132.1.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-de2877-openshift-default-b9fbff7d9-ngwrc

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-de2877-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-de2877-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-de2877-openshift-default

FailedUpdateStatus

horizontalpodautoscalers.autoscaling "e2e-praxis-a-de2877-openshift-default" not found
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

Unhealthy

Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

ProbeError

Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-502ec2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-502ec2

openshift-ingress

replicaset-controller

e2e-shared-b-w2-502ec2-openshift-default-68c9756987

SuccessfulCreate

Created pod: e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

openshift-ingress

deployment-controller

e2e-shared-b-w2-502ec2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-502ec2-openshift-default-68c9756987 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-861dfd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

AddedInterface

Add eth0 [10.132.1.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e2f0bd-7b98bf5d5f-jqjpt

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-861dfd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e2f0bd-9f97d6cff-kzhcz

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867

SuccessfulCreate

Created pod: e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-c0d50c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-c0d50c

openshift-ingress

deployment-controller

e2e-shared-b-w4-c0d50c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-c0d50c-openshift-default-59d947f867 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

AddedInterface

Add eth0 [10.132.1.31/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-502ec2: serviceaccount "payload-processing-e2e-shared-b-w2-502ec2" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-502ec2: serviceaccount "payload-processing-e2e-shared-b-w2-502ec2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-502ec2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-502ec2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-502ec2-5b958857d9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd

AddedInterface

Add eth0 [10.132.1.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

AddedInterface

Add eth0 [10.132.1.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-c0d50c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-c0d50c: serviceaccount "payload-processing-e2e-shared-b-w4-c0d50c" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-c0d50c: serviceaccount "payload-processing-e2e-shared-b-w4-c0d50c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-c0d50c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr

AddedInterface

Add eth0 [10.132.1.34/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-hbjsw

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 3 to 2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hbjsw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-e2f0bd-openshift-default-746bc78f85-d7xtl

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr

AddedInterface

Add eth0 [10.132.1.35/23] from ovn-kubernetes
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-2339ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-2339ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787

SuccessfulCreate

Created pod: e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

openshift-ingress

deployment-controller

e2e-shared-b-w1-a5f70c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-a5f70c-openshift-default-56495bf787 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-a5f70c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-a5f70c

openshift-ingress

multus

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

AddedInterface

Add eth0 [10.132.1.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-a5f70c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f from 0 to 1
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-861dfd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-a5f70c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5 from 0 to 1
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-861dfd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-a5f70c: serviceaccount "payload-processing-e2e-shared-b-w1-a5f70c" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-a5f70c: serviceaccount "payload-processing-e2e-shared-b-w1-a5f70c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62

Started

Container started
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-cmg7d
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cmg7d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-cmg7d

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cmg7d

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cmg7d

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cmg7d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cmg7d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-autores-dffe64-openshift-default-58c6cb4585

SuccessfulCreate

Created pod: e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

openshift-ingress

deployment-controller

e2e-autores-dffe64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-dffe64-openshift-default-58c6cb4585 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-dffe64

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-dffe64

openshift-ingress

multus

e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

AddedInterface

Add eth0 [10.132.1.39/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-a5f70c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-a5f70c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

Started

Container started

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-dffe64

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-dffe64-6b794cbd59 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-dffe64

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-dffe64-7c97ff4879 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-dffe64-6b794cbd59

FailedCreate

Error creating: pods "payload-processing-e2e-autores-dffe64-6b794cbd59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-dffe64: serviceaccount "payload-processing-e2e-autores-dffe64" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-dffe64-7c97ff4879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-dffe64-7c97ff4879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-dffe64: serviceaccount "payload-processing-e2e-autores-dffe64" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-dffe64-7c97ff4879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-dffe64-7c97ff4879-mmcqp

openshift-ingress

multus

payload-pre-processing-e2e-autores-dffe64-7c97ff4879-mmcqp

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dffe64-7c97ff4879-mmcqp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dffe64-7c97ff4879-mmcqp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dffe64-7c97ff4879-mmcqp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-dffe64-6b794cbd59-ldmrg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-dffe64-6b794cbd59

SuccessfulCreate

Created pod: payload-processing-e2e-autores-dffe64-6b794cbd59-ldmrg

openshift-ingress

multus

payload-processing-e2e-autores-dffe64-6b794cbd59-ldmrg

AddedInterface

Add eth0 [10.132.1.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-dffe64-6b794cbd59-ldmrg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-dffe64-6b794cbd59-ldmrg

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

ProbeError

Startup probe error: Get "http://10.132.1.28:15021/healthz/ready": dial tcp 10.132.1.28:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

Unhealthy

Startup probe failed: Get "http://10.132.1.28:15021/healthz/ready": dial tcp 10.132.1.28:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ab9b62-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ab9b62-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ab9b62-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ab9b62-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

Unhealthy

Readiness probe failed: Get "http://10.132.1.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

ProbeError

Readiness probe error: Get "http://10.132.1.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-502ec2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-502ec2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

ProbeError

Startup probe error: Get "http://10.132.1.30:15021/healthz/ready": dial tcp 10.132.1.30:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

Unhealthy

Startup probe failed: Get "http://10.132.1.30:15021/healthz/ready": dial tcp 10.132.1.30:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

ProbeError

Startup probe error: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

Unhealthy

Startup probe failed: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-8b85a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-8b85a6

openshift-ingress

deployment-controller

e2e-praxis-b-8b85a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7

SuccessfulCreate

Created pod: e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

openshift-ingress

multus

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

AddedInterface

Add eth0 [10.132.1.42/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-8b85a6-fc886dbf

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-8b85a6-fc886dbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-8b85a6: serviceaccount "payload-processing-e2e-praxis-b-8b85a6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-8b85a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-jk294
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-8b85a6: serviceaccount "payload-processing-e2e-praxis-b-8b85a6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-8b85a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-8b85a6-fc886dbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-8b85a6-fc886dbf

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-8b85a6-fc886dbf-wv89z

openshift-ingress

multus

payload-processing-e2e-praxis-b-8b85a6-fc886dbf-wv89z

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-jk294

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-jk294

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-8b85a6-fc886dbf-wv89z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-jk294

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-jk294

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-8b85a6-fc886dbf-wv89z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-8b85a6-fc886dbf-wv89z

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-c0d50c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-c0d50c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-502ec2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-502ec2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-8b85a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-8b85a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

Unhealthy

Startup probe failed: Get "http://10.132.1.39:15021/healthz/ready": dial tcp 10.132.1.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

ProbeError

Startup probe error: Get "http://10.132.1.39:15021/healthz/ready": dial tcp 10.132.1.39:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dffe64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dffe64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-jh7tc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

Unhealthy

Readiness probe failed: Get "http://10.132.1.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

ProbeError

Readiness probe error: Get "http://10.132.1.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

ProbeError

Startup probe error: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

Unhealthy

Startup probe failed: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w2-2339ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459

SuccessfulCreate

Created pod: e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-2339ed-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-a5f70c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-a5f70c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

ProbeError

Startup probe error: Get "http://10.132.1.42:15021/healthz/ready": dial tcp 10.132.1.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

Unhealthy

Startup probe failed: Get "http://10.132.1.42:15021/healthz/ready": dial tcp 10.132.1.42:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-jxdtb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-gsz9m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-68b77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-97vbn

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-qmspd

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-md2rx

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-4gbwl

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

Unhealthy

Readiness probe failed: Get "http://10.132.1.1:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-6j95q

ProbeError

Readiness probe error: Get "http://10.132.1.1:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-8b85a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-8b85a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-22nj7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

ProbeError

Readiness probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-pzd8p

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-lx6qf

Unhealthy

Readiness probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-pzd8p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-khbhb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-w8fbf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-cmg7d

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cmg7d

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulDelete

Deleted pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hd5jm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-dd5b85-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-bn7rl

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-nd7dn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-9360eb-openshift-default-6b47969f67

SuccessfulDelete

Deleted pod: e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-2fn6h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dffe64-7c97ff4879-mmcqp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-dffe64-6b794cbd59-ldmrg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-dffe64-openshift-default-58c6cb4585-d2xzt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-856ddc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-856ddc-openshift-default-75fb57976f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-856ddc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-856ddc

openshift-ingress

replicaset-controller

e2e-explicit-856ddc-openshift-default-75fb57976f

SuccessfulCreate

Created pod: e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

openshift-ingress

multus

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-856ddc-7ddfb87755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-856ddc: serviceaccount "payload-processing-e2e-explicit-856ddc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-856ddc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-856ddc-f64f5dddf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-856ddc-f64f5dddf

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-856ddc-f64f5dddf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-856ddc: serviceaccount "payload-processing-e2e-explicit-856ddc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-856ddc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-856ddc-7ddfb87755 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-856ddc-f64f5dddf-wbt7c

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-856ddc-f64f5dddf

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-856ddc-f64f5dddf-wbt7c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-856ddc-7ddfb87755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-7qg7x

openshift-ingress

kubelet

payload-processing-e2e-explicit-856ddc-f64f5dddf-wbt7c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-856ddc-f64f5dddf-wbt7c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-856ddc-f64f5dddf-wbt7c

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-7qg7x

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-7qg7x

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-7qg7x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-7qg7x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-856ddc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-856ddc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7205-2b0ef4

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7205-2b0ef4

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7205-2b0ef4

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.49s (2.49s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7205-2b0ef4

Created

Container created

opendatahub

kubelet

test-curl-7205-2b0ef4

Started

Container started

opendatahub

kubelet

test-curl-7205-2b0ef4

Killing

Stopping container test-curl-7205-2b0ef4

opendatahub

kubelet

test-curl-7205-70ec18

Created

Container created

opendatahub

multus

test-curl-7205-70ec18

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7205-70ec18

Started

Container started

opendatahub

kubelet

test-curl-7205-70ec18

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7205-70ec18

Killing

Stopping container test-curl-7205-70ec18

opendatahub

kubelet

test-curl-7205-4dcafd

Created

Container created

opendatahub

kubelet

test-curl-7205-4dcafd

Started

Container started

opendatahub

kubelet

test-curl-7205-4dcafd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7205-4dcafd

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9360eb-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

Killing

Stopping container istio-proxy
(x10)

openshift-ingress

deployment-controller

e2e-worker-w4-9360eb-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-9360eb-openshift-default-6b47969f67 from 3 to 1

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7205-7a9a33

Started

Container started

opendatahub

kubelet

test-curl-7205-4dcafd

Killing

Stopping container test-curl-7205-4dcafd

opendatahub

multus

test-curl-7205-7a9a33

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7205-7a9a33

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7205-7a9a33

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 3 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-zlr4p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-7205-671367

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7205-671367

Started

Container started

opendatahub

multus

test-curl-7205-671367

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7205-671367

Created

Container created

opendatahub

kubelet

test-curl-7205-7a9a33

Killing

Stopping container test-curl-7205-7a9a33

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-wkbbr

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

opendatahub

multus

test-curl-7205-5c0940

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7205-671367

Killing

Stopping container test-curl-7205-671367

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-gq2j8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-7205-5c0940

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7205-5c0940

Created

Container created

opendatahub

kubelet

test-curl-7205-5c0940

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-cf5lm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-7205-5c0940

Killing

Stopping container test-curl-7205-5c0940

openshift-ingress

deployment-controller

e2e-extmod-a-c7585c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-c7585c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-c7585c
(x2)

openshift-ingress

kubelet

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7

SuccessfulCreate

Created pod: e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

openshift-ingress

multus

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-c7585c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-c7585c-c6bd6c7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c7585c: serviceaccount "payload-processing-e2e-extmod-a-c7585c" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c7585c-c6bd6c7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-c7585c-c6bd6c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c7585c: serviceaccount "payload-processing-e2e-extmod-a-c7585c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-c7585c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c7585c-c6bd6c7-xtwpk

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c7585c-c6bd6c7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-c7585c-c6bd6c7-xtwpk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-zlb2z

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-zlb2z

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c7585c-c6bd6c7-xtwpk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c7585c-c6bd6c7-xtwpk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-c7585c-c6bd6c7-xtwpk

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-zlb2z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-zlb2z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-zlb2z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9b62-6cdd9fbb87-xsbm6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9b62-5c6cd9644c-xnh44

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c7585c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c7585c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-e8fa21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-e8fa21

openshift-ingress

deployment-controller

e2e-extmod-a-e8fa21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e8fa21-openshift-default-5b44854b5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c

SuccessfulCreate

Created pod: e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-856ddc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-856ddc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-e8fa21

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e8fa21: serviceaccount "payload-processing-e2e-extmod-a-e8fa21" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-82k62
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e8fa21: serviceaccount "payload-processing-e2e-extmod-a-e8fa21" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-6lxkk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-e8fa21

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-6lxkk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-82k62

AddedInterface

Add eth0 [10.132.1.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-6lxkk

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-6lxkk

AddedInterface

Add eth0 [10.132.1.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-82k62

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-6lxkk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-82k62

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-82k62

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-ab9b62-openshift-default-59c8cbd769-2lnkm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-8b85a6-fc886dbf-wv89z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-8b85a6-64f64c75c5-jk294

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-8b85a6-openshift-default-6754cfb9c7-zhbfm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9

SuccessfulCreate

Created pod: e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-5901fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-5901fe

openshift-ingress

deployment-controller

e2e-shared-a-w0-5901fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

AddedInterface

Add eth0 [10.132.1.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-5901fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-5901fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-5901fe-769bf9697c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-5901fe-769bf9697c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-c4dr8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-5901fe-769bf9697c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-5901fe: serviceaccount "payload-processing-e2e-shared-a-w0-5901fe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-4xztp
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-5901fe: serviceaccount "payload-processing-e2e-shared-a-w0-5901fe" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-c4dr8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-c4dr8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-4xztp

AddedInterface

Add eth0 [10.132.1.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-4xztp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-4xztp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-4xztp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-c4dr8

AddedInterface

Add eth0 [10.132.1.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-c4dr8

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-d8190b-openshift-default-b6499c977

SuccessfulCreate

Created pod: e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

openshift-ingress

deployment-controller

e2e-extmod-a-d8190b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d8190b-openshift-default-b6499c977 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d8190b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d8190b

openshift-ingress

multus

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

AddedInterface

Add eth0 [10.132.1.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d8190b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d8190b-57d559946c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d8190b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d8190b-64dfdcf95f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d8190b-57d559946c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-sdx7g
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d8190b-57d559946c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d8190b: serviceaccount "payload-processing-e2e-extmod-a-d8190b" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d8190b-64dfdcf95f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d8190b: serviceaccount "payload-processing-e2e-extmod-a-d8190b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d8190b-64dfdcf95f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-slpct

openshift-ingress

multus

payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-slpct

AddedInterface

Add eth0 [10.132.1.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-c7585c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7 from 1 to 4

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-sdx7g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-sdx7g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-sdx7g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-slpct

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-slpct

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-sdx7g

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7

SuccessfulCreate

Created pod: e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

openshift-ingress

replicaset-controller

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7

SuccessfulCreate

Created pod: e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

openshift-ingress

replicaset-controller

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7

SuccessfulCreate

Created pod: e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c7585c-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-slpct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

Started

Container started

openshift-ingress

multus

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

AddedInterface

Add eth0 [10.132.1.66/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

ProbeError

Readiness probe error: Get "http://10.133.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

Unhealthy

Readiness probe failed: Get "http://10.133.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

ProbeError

Startup probe error: Get "http://10.132.1.66:15021/healthz/ready": dial tcp 10.132.1.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

Unhealthy

Startup probe failed: Get "http://10.132.1.66:15021/healthz/ready": dial tcp 10.132.1.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c7585c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c7585c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-1f1314

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-1f1314

openshift-ingress

replicaset-controller

e2e-extmod-b-1f1314-openshift-default-6b76475b9

SuccessfulCreate

Created pod: e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

openshift-ingress

deployment-controller

e2e-extmod-b-1f1314-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-1f1314-openshift-default-6b76475b9 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

AddedInterface

Add eth0 [10.132.1.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-1f1314-7985cfb565

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-1f1314-7985cfb565-4sz97
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-1f1314: serviceaccount "payload-processing-e2e-extmod-b-1f1314" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-1f1314-7985cfb565

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-1f1314-7985cfb565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-1f1314: serviceaccount "payload-processing-e2e-extmod-b-1f1314" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-1f1314

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-1f1314

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-1f1314-7985cfb565 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-qj6lg

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-qj6lg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-qj6lg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1f1314-7985cfb565-4sz97

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1f1314-7985cfb565-4sz97

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-1f1314-7985cfb565-4sz97

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-qj6lg

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-qj6lg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1f1314-7985cfb565-4sz97

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e8fa21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e8fa21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-explicit-856ddc-f64f5dddf-wbt7c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-856ddc-7ddfb87755-7qg7x

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e8fa21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e8fa21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

Started

Container started

openshift-ingress

kubelet

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-5901fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-noten-23258c-openshift-default-6ccf7f9cdc

SuccessfulCreate

Created pod: e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

openshift-ingress

deployment-controller

e2e-noten-23258c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-23258c-openshift-default-6ccf7f9cdc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-23258c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-23258c
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-5901fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

Created

Container created

openshift-ingress

kubelet

e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

Unhealthy

Startup probe failed: Get "http://10.132.1.61:15021/healthz/ready": dial tcp 10.132.1.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

ProbeError

Startup probe error: Get "http://10.132.1.61:15021/healthz/ready": dial tcp 10.132.1.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-856ddc-openshift-default-75fb57976f-7fl4w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-extmod-b-0d5219-openshift-default-5665c7cd49

SuccessfulCreate

Created pod: e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0d5219

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0d5219

openshift-ingress

deployment-controller

e2e-extmod-b-0d5219-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0d5219-openshift-default-5665c7cd49 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0d5219

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0d5219-767499cc67 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0d5219

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0d5219: serviceaccount "payload-processing-e2e-extmod-b-0d5219" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-zszdg
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0d5219-767499cc67

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0d5219-767499cc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0d5219: serviceaccount "payload-processing-e2e-extmod-b-0d5219" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0d5219-767499cc67

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0d5219-767499cc67-vpv4t

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-zszdg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-zszdg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d5219-767499cc67-vpv4t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d5219-767499cc67-vpv4t

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-zszdg

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-zszdg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-0d5219-767499cc67-vpv4t

AddedInterface

Add eth0 [10.132.1.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d5219-767499cc67-vpv4t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-5901fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-5901fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d8190b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d8190b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

ProbeError

Startup probe error: Get "http://10.132.1.64:15021/healthz/ready": dial tcp 10.132.1.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

Unhealthy

Startup probe failed: Get "http://10.132.1.64:15021/healthz/ready": dial tcp 10.132.1.64:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-23258c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-23258c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-23258c-openshift-default-6ccf7f9cdc-hxb5h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d8190b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d8190b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d5219-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d5219-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857

SuccessfulCreate

Created pod: e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-cfbb5b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-cfbb5b

openshift-ingress

deployment-controller

e2e-shared-b-w0-cfbb5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-cfbb5b-openshift-default-584b998857 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-cfbb5b: serviceaccount "payload-processing-e2e-shared-b-w0-cfbb5b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-cfbb5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-cfbb5b: serviceaccount "payload-processing-e2e-shared-b-w0-cfbb5b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-zddlk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-cfbb5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-wwfsg

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-wwfsg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-wwfsg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-zddlk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-zddlk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-zddlk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-zddlk

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-wwfsg

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-wwfsg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1f1314-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1f1314-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

ProbeError

Startup probe error: Get "http://10.132.1.67:15021/healthz/ready": dial tcp 10.132.1.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

Unhealthy

Startup probe failed: Get "http://10.132.1.67:15021/healthz/ready": dial tcp 10.132.1.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d8190b-57d559946c-sdx7g

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1f1314-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1f1314-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d8190b-64dfdcf95f-slpct

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-extmod-a-d253a5-openshift-default-875544d77

SuccessfulCreate

Created pod: e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d253a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d253a5

openshift-ingress

deployment-controller

e2e-extmod-a-d253a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d253a5-openshift-default-875544d77 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

AddedInterface

Add eth0 [10.132.1.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-2339ed-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-2339ed-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459

SuccessfulDelete

Deleted pod: e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-9m5qm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d253a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d253a5-846cf546b7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d253a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d253a5-846cf546b7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d253a5-846cf546b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d253a5: serviceaccount "payload-processing-e2e-extmod-a-d253a5" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-vt6qv

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d253a5-846cf546b7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d253a5-846cf546b7-22cbm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d253a5: serviceaccount "payload-processing-e2e-extmod-a-d253a5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-vt6qv

openshift-ingress

multus

payload-processing-e2e-extmod-a-d253a5-846cf546b7-22cbm

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-vt6qv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d253a5-846cf546b7-22cbm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d253a5-846cf546b7-22cbm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d253a5-846cf546b7-22cbm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-vt6qv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-vt6qv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c7585c-c6bd6c7-xtwpk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c7585c-bc54c9dc-zlb2z

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d5219-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d5219-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-d8190b-openshift-default-b6499c977-lf4mh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-57fdb56688

FailedCreate

Error creating: pods "payload-processing-external-model-57fdb56688-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-57fdb56688 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-57fdb56688

SuccessfulCreate

Created pod: payload-processing-external-model-57fdb56688-j2l9b

models-as-a-service

kubelet

payload-processing-external-model-57fdb56688-j2l9b

Started

Container started

models-as-a-service

multus

payload-processing-external-model-57fdb56688-j2l9b

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-57fdb56688-j2l9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-57fdb56688-j2l9b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

ProbeError

Startup probe error: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

Unhealthy

Startup probe failed: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8fa21-7c8ddb7cd9-82k62

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8fa21-7874d5664c-6lxkk

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c7585c-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7

SuccessfulDelete

Deleted pod: e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

openshift-ingress

replicaset-controller

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7

SuccessfulDelete

Deleted pod: e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-nl7ln

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-c7585c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7 from 4 to 2
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-cfbb5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-cfbb5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

ProbeError

Readiness probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-89czh

Unhealthy

Readiness probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-kfbdx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-c7585c-openshift-default-b5c7bbbf7-vqxf2

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d253a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d253a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

Unhealthy

Startup probe failed: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

ProbeError

Startup probe error: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1f1314-7985cfb565-4sz97

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1f1314-595c6dfbdc-qj6lg

Killing

Stopping container payload-pre-processing

models-as-a-service

kubelet

payload-processing-external-model-57fdb56688-j2l9b

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d253a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6b9b48ccc9 from 0 to 1
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-6b9b48ccc9

FailedCreate

Error creating: pods "payload-processing-external-model-6b9b48ccc9-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d253a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

replicaset-controller

payload-processing-external-model-6b9b48ccc9

SuccessfulCreate

Created pod: payload-processing-external-model-6b9b48ccc9-chpnh

models-as-a-service

multus

payload-processing-external-model-6b9b48ccc9-chpnh

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-chpnh

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-chpnh

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-chpnh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-chpnh

Killing

Stopping container payload-processing
(x4)

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-chpnh

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-3070c2924b04" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-5901fe-7cffc6c69f-4xztp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-5901fe-769bf9697c-c4dr8

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-ppc6s

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-ppc6s

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6b9b48ccc9 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ppc6s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ppc6s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ppc6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-lxq9w

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-fwqzv

AddedInterface

Add eth0 [10.132.1.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 1 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-fwqzv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-lxq9w

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-6b9b48ccc9

FailedCreate

Error creating: pods "payload-processing-external-model-6b9b48ccc9-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-6b9b48ccc9

SuccessfulCreate

Created pod: payload-processing-external-model-6b9b48ccc9-qt58k

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-qt58k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6b9b48ccc9-qt58k

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-qt58k

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-qt58k

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-qt58k

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

ProbeError

Startup probe error: Get "http://10.132.1.72:15021/healthz/ready": dial tcp 10.132.1.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ppc6s

ProbeError

Startup probe error: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ppc6s

Unhealthy

Startup probe failed: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Unhealthy

Startup probe failed: Get "http://10.132.1.72:15021/healthz/ready": dial tcp 10.132.1.72:15021: connect: connection refused
(x4)

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-qt58k

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-external-model-plugins" not found
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

ProbeError

Startup probe error: Get "http://10.132.1.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ppc6s

ProbeError

Startup probe error: Get "http://10.134.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

models-as-a-service

kubelet

payload-processing-external-model-6b9b48ccc9-qt58k

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-3070c2924b04" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7464ffdbfc from 0 to 1
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ppc6s

Unhealthy

Startup probe failed: Get "http://10.134.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Unhealthy

Startup probe failed: Get "http://10.132.1.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-7464ffdbfc

SuccessfulCreate

Created pod: payload-processing-external-model-7464ffdbfc-fmsph
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-7464ffdbfc

FailedCreate

Error creating: pods "payload-processing-external-model-7464ffdbfc-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found
(x3)

models-as-a-service

kubelet

payload-processing-external-model-7464ffdbfc-fmsph

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-7867d6f13f6b" not found

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f0e007

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f0e007

openshift-ingress

deployment-controller

e2e-inf-a-f0e007-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f0e007-openshift-default-79fbbff9bc from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-f0e007-openshift-default-79fbbff9bc

SuccessfulCreate

Created pod: e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

openshift-ingress

multus

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

AddedInterface

Add eth0 [10.132.1.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f0e007

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f0e007-ffdb68675 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f0e007

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f0e007-68bb6c7d5c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-729bv

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-5dpw5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f0e007-68bb6c7d5c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-729bv
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f0e007-68bb6c7d5c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f0e007: serviceaccount "payload-processing-e2e-inf-a-f0e007" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-5dpw5

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f0e007-ffdb68675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-5dpw5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f0e007-ffdb68675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f0e007: serviceaccount "payload-processing-e2e-inf-a-f0e007" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-5dpw5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-5dpw5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-729bv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-729bv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-729bv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-e8fa21-openshift-default-5b44854b5c-cvjc9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d253a5-fb684cb79-vt6qv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d253a5-846cf546b7-22cbm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d5219-767499cc67-vpv4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d5219-54d6bbdc55-zszdg

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-gh4g9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-jdrnv

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 4 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gh4g9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-gh4g9

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gh4g9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gh4g9

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-jdrnv

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jdrnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jdrnv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jdrnv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-83f052-openshift-default-586d975ff

SuccessfulCreate

Created pod: e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

openshift-ingress

gateway_labeler_controller

e2e-inf-a-83f052

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-83f052

openshift-ingress

deployment-controller

e2e-inf-a-83f052-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-83f052-openshift-default-586d975ff from 0 to 1

openshift-ingress

multus

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gh4g9

Unhealthy

Startup probe failed: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gh4g9

ProbeError

Startup probe error: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jdrnv

ProbeError

Startup probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jdrnv

Unhealthy

Startup probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-0d5219-openshift-default-5665c7cd49-4l24p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-83f052

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-83f052-7dcf7f9c85 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-83f052-7dcf7f9c85

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-83f052-7dcf7f9c85-7gwt5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-83f052-fd69f94c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-q9qrf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-83f052

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-83f052-fd69f94c9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-83f052-fd69f94c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-83f052: serviceaccount "payload-processing-e2e-inf-a-83f052" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-83f052-7dcf7f9c85

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-83f052-7dcf7f9c85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-83f052: serviceaccount "payload-processing-e2e-inf-a-83f052" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-83f052-7dcf7f9c85-7gwt5

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-q9qrf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-83f052-7dcf7f9c85-7gwt5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-83f052-7dcf7f9c85-7gwt5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-83f052-7dcf7f9c85-7gwt5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-q9qrf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-q9qrf

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-q9qrf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-1f1314-openshift-default-6b76475b9-spcj2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-e53098-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e53098-openshift-default-75b4bbb4c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-e53098-openshift-default-75b4bbb4c

SuccessfulCreate

Created pod: e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e53098

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e53098

openshift-ingress

multus

e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

AddedInterface

Add eth0 [10.132.1.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-5901fe-openshift-default-74f55d57c9-9q7hd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e53098

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e53098-5779d5c545 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e53098-5779d5c545

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e53098-5779d5c545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e53098: serviceaccount "payload-processing-e2e-inf-a-e53098" not found

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 6 to 10

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e53098

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-6rp2d

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-vh5lb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-cb4gc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-jg5sl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-cb4gc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-6rp2d

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-vh5lb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-vh5lb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e53098: serviceaccount "payload-processing-e2e-inf-a-e53098" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-68rm8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jg5sl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jg5sl

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-vh5lb

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-6rp2d

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-6rp2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-6rp2d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jg5sl

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e53098-5779d5c545

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e53098-5779d5c545-x4rhv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-vh5lb

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-jg5sl

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-cb4gc

AddedInterface

Add eth0 [10.132.1.75/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-cb4gc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-cb4gc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-68rm8

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-e53098-5779d5c545-x4rhv

AddedInterface

Add eth0 [10.132.1.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-68rm8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e53098-5779d5c545-x4rhv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-68rm8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e53098-5779d5c545-x4rhv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e53098-5779d5c545-x4rhv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-68rm8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-cfbb5b-7985d9687-wwfsg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-cfbb5b-6665b44d47-zddlk

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-vh5lb

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-cb4gc

Unhealthy

Startup probe failed: Get "http://10.132.1.75:15021/healthz/ready": dial tcp 10.132.1.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-vh5lb

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-cb4gc

ProbeError

Startup probe error: Get "http://10.132.1.75:15021/healthz/ready": dial tcp 10.132.1.75:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jg5sl

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-6rp2d

Unhealthy

Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jg5sl

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-6rp2d

ProbeError

Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-d247af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d247af-openshift-default-866457bbcc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-d247af-openshift-default-866457bbcc

SuccessfulCreate

Created pod: e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

openshift-ingress

kubelet

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-cfbb5b-openshift-default-584b998857-frx4s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d247af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d247af

openshift-ingress

multus

e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

AddedInterface

Add eth0 [10.132.1.77/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e53098-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e53098-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d247af-57fc994bb7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d247af-57fc994bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d247af: serviceaccount "payload-processing-e2e-extmod-a-d247af" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d247af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d247af-5c87c68687 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d247af-5c87c68687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d247af: serviceaccount "payload-processing-e2e-extmod-a-d247af" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d247af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d247af-57fc994bb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d247af-57fc994bb7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d247af-57fc994bb7-p5nv6

openshift-ingress

multus

payload-processing-e2e-extmod-a-d247af-57fc994bb7-p5nv6

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d247af-5c87c68687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-fdkss

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-fdkss

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-fdkss

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-fdkss

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d247af-57fc994bb7-p5nv6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d247af-57fc994bb7-p5nv6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d247af-57fc994bb7-p5nv6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-fdkss

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d247af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d247af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-d253a5-openshift-default-875544d77-76bvw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-e2a54d-openshift-default-597d99bc45

SuccessfulCreate

Created pod: e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

openshift-ingress

deployment-controller

e2e-inf-a-e2a54d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e2a54d-openshift-default-597d99bc45 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e2a54d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e2a54d

openshift-ingress

multus

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

AddedInterface

Add eth0 [10.132.1.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e2a54d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e2a54d: serviceaccount "payload-processing-e2e-inf-a-e2a54d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-942wm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e2a54d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-8sz4f
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e2a54d: serviceaccount "payload-processing-e2e-inf-a-e2a54d" not found

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

Unhealthy

Readiness probe failed: Get "http://10.132.1.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

ProbeError

Readiness probe error: Get "http://10.132.1.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-8sz4f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-942wm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-8sz4f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-8sz4f

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-942wm

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-942wm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-8sz4f

AddedInterface

Add eth0 [10.132.1.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-942wm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

Unhealthy

Startup probe failed: Get "http://10.132.1.73:15021/healthz/ready": dial tcp 10.132.1.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

ProbeError

Startup probe error: Get "http://10.132.1.73:15021/healthz/ready": dial tcp 10.132.1.73:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-f0e007-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-f0e007-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

Unhealthy

Readiness probe failed: Get "http://10.133.0.164:15021/healthz/ready": read tcp 10.133.0.2:35462->10.133.0.164:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

ProbeError

Readiness probe error: Get "http://10.133.0.164:15021/healthz/ready": read tcp 10.133.0.2:35462->10.133.0.164:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-b-243a29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-243a29-openshift-default-596fff8f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-243a29-openshift-default-596fff8f5

SuccessfulCreate

Created pod: e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

openshift-ingress

gateway_labeler_controller

e2e-inf-b-243a29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-243a29

openshift-ingress

multus

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

AddedInterface

Add eth0 [10.132.1.81/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

Unhealthy

Startup probe failed: Get "http://10.132.1.74:15021/healthz/ready": dial tcp 10.132.1.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

ProbeError

Startup probe error: Get "http://10.132.1.74:15021/healthz/ready": dial tcp 10.132.1.74:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-243a29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-243a29-dd8dddb6f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-243a29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-243a29-595f587ccf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-243a29-dd8dddb6f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-243a29-dd8dddb6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-243a29: serviceaccount "payload-processing-e2e-inf-b-243a29" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-243a29-dd8dddb6f-7kfkw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-243a29-dd8dddb6f-7kfkw

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-243a29-dd8dddb6f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-243a29-dd8dddb6f-7kfkw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-243a29-595f587ccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-243a29-595f587ccf-dp87r
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-243a29-595f587ccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-243a29-595f587ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-243a29: serviceaccount "payload-processing-e2e-inf-b-243a29" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-243a29-595f587ccf-dp87r

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-243a29-dd8dddb6f-7kfkw

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-83f052-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-243a29-595f587ccf-dp87r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-243a29-595f587ccf-dp87r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-243a29-595f587ccf-dp87r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-243a29-dd8dddb6f-7kfkw

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-83f052-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

ProbeError

Startup probe error: Get "http://10.132.1.77:15021/healthz/ready": dial tcp 10.132.1.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

Unhealthy

Startup probe failed: Get "http://10.132.1.77:15021/healthz/ready": dial tcp 10.132.1.77:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e53098-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e53098-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-b-6f30f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-6f30f2

openshift-ingress

deployment-controller

e2e-inf-b-6f30f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-6f30f2-openshift-default-94c897f67 from 0 to 1

openshift-ingress

multus

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-6f30f2-openshift-default-94c897f67

SuccessfulCreate

Created pod: e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-243a29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-243a29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6f30f2-66f76ccb97

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-6f30f2-66f76ccb97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6f30f2: serviceaccount "payload-processing-e2e-inf-b-6f30f2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-6f30f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6f30f2-66f76ccb97

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-6f30f2-66f76ccb97-qnt8n

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-6f30f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-6f30f2-66f76ccb97 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6f30f2: serviceaccount "payload-processing-e2e-inf-b-6f30f2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-57djf

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-57djf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-6f30f2-66f76ccb97-qnt8n

AddedInterface

Add eth0 [10.132.1.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

ProbeError

Readiness probe error: Get "http://10.132.1.78:15021/healthz/ready": read tcp 10.132.0.2:39882->10.132.1.78:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-57djf

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

Unhealthy

Readiness probe failed: Get "http://10.132.1.78:15021/healthz/ready": read tcp 10.132.0.2:39882->10.132.1.78:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6f30f2-66f76ccb97-qnt8n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-57djf

AddedInterface

Add eth0 [10.132.1.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-57djf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6f30f2-66f76ccb97-qnt8n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6f30f2-66f76ccb97-qnt8n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d247af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d247af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

Unhealthy

Startup probe failed: Get "http://10.132.1.78:15021/healthz/ready": dial tcp 10.132.1.78:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-e679fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e679fe-openshift-default-774df5789c from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

ProbeError

Startup probe error: Get "http://10.132.1.78:15021/healthz/ready": dial tcp 10.132.1.78:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e679fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e679fe

openshift-ingress

replicaset-controller

e2e-inf-b-e679fe-openshift-default-774df5789c

SuccessfulCreate

Created pod: e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

openshift-ingress

multus

e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e679fe-795c685c9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-kzn8t
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e679fe-5cf96d4ddc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e679fe: serviceaccount "payload-processing-e2e-inf-b-e679fe" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e679fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e679fe-795c685c9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e679fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e679fe-5cf96d4ddc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e679fe-795c685c9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e679fe: serviceaccount "payload-processing-e2e-inf-b-e679fe" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-kzn8t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-r49c9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-kzn8t

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-kzn8t

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e679fe-5cf96d4ddc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-r49c9

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-kzn8t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-r49c9

AddedInterface

Add eth0 [10.132.1.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-r49c9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-r49c9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d247af-5c87c68687-fdkss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d247af-57fc994bb7-p5nv6

Killing

Stopping container payload-processing
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e2a54d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e2a54d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2a54d-6d5467ddcf-942wm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2a54d-7b99f6fbbc-8sz4f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

Unhealthy

Readiness probe failed: Get "http://10.132.1.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

ProbeError

Readiness probe error: Get "http://10.132.1.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

ProbeError

Startup probe error: Get "http://10.132.1.81:15021/healthz/ready": dial tcp 10.132.1.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

Unhealthy

Startup probe failed: Get "http://10.132.1.81:15021/healthz/ready": dial tcp 10.132.1.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

ProbeError

Readiness probe error: Get "http://10.133.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

Unhealthy

Readiness probe failed: Get "http://10.133.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-243a29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-243a29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-d247af-openshift-default-866457bbcc-8bw94

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-c42c43

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-c42c43

openshift-ingress

replicaset-controller

e2e-inf-a-c42c43-openshift-default-64d4f8645

SuccessfulCreate

Created pod: e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

openshift-ingress

multus

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-c42c43-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-c42c43-openshift-default-64d4f8645 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c42c43-65465649bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-c42c43-65465649bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c42c43: serviceaccount "payload-processing-e2e-inf-a-c42c43" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c42c43: serviceaccount "payload-processing-e2e-inf-a-c42c43" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-f48b9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-c42c43

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-c42c43-65465649bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-c42c43

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c42c43-65465649bc-c5xxw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-f48b9

AddedInterface

Add eth0 [10.132.1.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-f48b9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c42c43-65465649bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-c42c43-65465649bc-c5xxw

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-c42c43-65465649bc-c5xxw

AddedInterface

Add eth0 [10.132.1.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c42c43-65465649bc-c5xxw

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-6f30f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-f48b9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-f48b9

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-6f30f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c42c43-65465649bc-c5xxw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f0e007-68bb6c7d5c-729bv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f0e007-ffdb68675-5dpw5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-gh4g9
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 10 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-jg5sl
(x2)

openshift-ingress

kubelet

e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jg5sl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gh4g9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e679fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e679fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-ppc6s

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 8 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jdrnv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-cb4gc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ppc6s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-jdrnv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-cb4gc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-vh5lb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-vh5lb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-83f052-7dcf7f9c85-7gwt5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-83f052-fd69f94c9-q9qrf

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e679fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e679fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e53098-5779d5c545-x4rhv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e53098-6d5f8d7879-68rm8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-f0e007-openshift-default-79fbbff9bc-6cbkd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-243a29-595f587ccf-dp87r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-243a29-dd8dddb6f-7kfkw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-e2a54d-openshift-default-597d99bc45-pkw4n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-83f052-openshift-default-586d975ff-mr2zm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6f30f2-66f76ccb97-qnt8n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6f30f2-fb67659dc-57djf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hxx62

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hxx62

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-e53098-openshift-default-75b4bbb4c-7mlql

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-c42c43-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-c42c43-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

ProbeError

Startup probe error: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

Unhealthy

Startup probe failed: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e679fe-795c685c9f-kzn8t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e679fe-5cf96d4ddc-r49c9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 4 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gl6cz

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-bwzrc

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gl6cz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-bgjqj

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bwzrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gl6cz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bwzrc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bgjqj

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-qcfrt

AddedInterface

Add eth0 [10.132.1.96/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-6886b96f9-bgjqj

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-gl6cz

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bgjqj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bwzrc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bgjqj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-qcfrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-qcfrt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-qcfrt

Started

Container started
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bgjqj

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bgjqj

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gl6cz

ProbeError

Startup probe error: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bwzrc

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bwzrc

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-qcfrt

ProbeError

Startup probe error: Get "http://10.132.1.96:15021/healthz/ready": dial tcp 10.132.1.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-qcfrt

Unhealthy

Startup probe failed: Get "http://10.132.1.96:15021/healthz/ready": dial tcp 10.132.1.96:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gl6cz

Unhealthy

Startup probe failed: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-npjlx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-npjlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jlkc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jlkc2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jlkc2

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-npjlx

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-jlkc2

AddedInterface

Add eth0 [10.132.1.97/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-npjlx

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-npjlx

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jlkc2

ProbeError

Startup probe error: Get "http://10.132.1.97:15021/healthz/ready": dial tcp 10.132.1.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-npjlx

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jlkc2

Unhealthy

Startup probe failed: Get "http://10.132.1.97:15021/healthz/ready": dial tcp 10.132.1.97:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-c42c43-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-c42c43-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c42c43-7d4c7fd4d7-f48b9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c42c43-65465649bc-c5xxw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-243a29-openshift-default-596fff8f5-zn2w4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-6f30f2-openshift-default-94c897f67-n54px

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e679fe-openshift-default-774df5789c-tmhrq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-c42c43-openshift-default-64d4f8645-qxn4r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7778d0-54f4b4967c-xv4zq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7778d0-77b568fd9f-2pjlc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7778d0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-7778d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7778d0-openshift-default-56c8f7f987 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-7778d0-openshift-default-56c8f7f987

SuccessfulCreate

Created pod: e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

Started

Container started
(x4)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

Unhealthy

Startup probe failed: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-ksczs

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

ProbeError

Startup probe error: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-7778d0-openshift-default-56c8f7f987-tthrx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Unhealthy

Readiness probe failed: Get "http://10.132.1.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

ProbeError

Readiness probe error: Get "http://10.132.1.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-26c74d32-openshift-default-5f887dbf77

SuccessfulCreate

Created pod: e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

openshift-ingress

multus

e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-26c74d32

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-26c74d32

openshift-ingress

deployment-controller

e2e-mt-26c74d32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-26c74d32-openshift-default-5f887dbf77 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-26c74d32-b558f8d67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-26c74d32-b558f8d67-kvxgr
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-26c74d32-6747c4bc7c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-26c74d32-6747c4bc7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-26c74d32: serviceaccount "payload-processing-e2e-mt-26c74d32" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-26c74d32-b558f8d67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-26c74d32-b558f8d67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-26c74d32: serviceaccount "payload-processing-e2e-mt-26c74d32" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-26c74d32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-26c74d32-6747c4bc7c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-26c74d32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-26c74d32-b558f8d67 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-26c74d32-b558f8d67-kvxgr

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-26c74d32-6747c4bc7c-llhgz

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26c74d32-b558f8d67-kvxgr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26c74d32-b558f8d67-kvxgr

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-26c74d32-6747c4bc7c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-26c74d32-6747c4bc7c-llhgz

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26c74d32-b558f8d67-kvxgr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-26c74d32-6747c4bc7c-llhgz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-26c74d32-6747c4bc7c-llhgz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-26c74d32-6747c4bc7c-llhgz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd5b85-68fc6966f9-5msv9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd5b85-6f75c7b449-79chc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

deployment-controller

e2e-worker-w3-dd5b85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7 from 1 to 2
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd5b85-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7

SuccessfulCreate

Created pod: e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

ProbeError

Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

Unhealthy

Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

Unhealthy

Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

ProbeError

Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-whgrb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-dd5b85-openshift-default-df7b5cdd7-jkwff

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-26c74d32-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-26c74d32-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

Unhealthy

Startup probe failed: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

ProbeError

Startup probe error: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-26c74d32-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-26c74d32-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-861dfd-655b9bdd89-74pgp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-861dfd-75b46f47c5-fwkbx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-861dfd-openshift-default-7674fcd955-jwqp2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-26c74d32-6747c4bc7c-llhgz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26c74d32-b558f8d67-kvxgr

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-a5f70c-66845bbcc5-cwrh9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-a5f70c-5f89d5474f-p2x62

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-a5f70c-openshift-default-56495bf787-g8zg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-fwqzv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-npjlx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 10 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6886b96f9-npjlx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-qcfrt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-hxx62

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bgjqj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-jlkc2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-fwqzv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-26c74d32-openshift-default-5f887dbf77-pgkfj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2339ed-56d678b89f-fppm6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2339ed-786bf5c4f7-9htx9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d39257-6847b799d7-rfs7m

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-gl6cz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d39257-6fbd4997d5-bgg6p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-93f411-67468fb94c-rrbn6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-93f411-8549bb767c-7zxng

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-2339ed-openshift-default-7c5f9b9459-kq8x8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-93f411-openshift-default-554df87979-6cgxt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm

Created

Container created

openshift-ingress

multus

e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-d39257-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d39257-openshift-default-7f9c647847 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d39257-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d39257-openshift-default-7f9c647847

SuccessfulCreate

Created pod: e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm
(x3)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm

ProbeError

Startup probe error: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm

Unhealthy

Startup probe failed: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-kp6mm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d39257-openshift-default-7f9c647847-zx2z2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c0d50c-8fdc57f-cpzwr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c0d50c-74c58cbdd5-f4tnr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-502ec2-openshift-default-68c9756987-2m7tb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-502ec2-7cbd64d88c-gbbsd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-502ec2-5b958857d9-jcj9k

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.1.33:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w4-c0d50c-openshift-default-59d947f867-ngmwc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b59563-7b58f8bfc5-kl5rs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b59563-6545bb797f-4szhr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b59563-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-b59563-openshift-default-6df66b7897

SuccessfulCreate

Created pod: e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9360eb-8548f6fb95-lwzhx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-b59563-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b59563-openshift-default-6df66b7897 from 1 to 2
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9360eb-7cc4854c7-8jmvh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

AddedInterface

Add eth0 [10.132.1.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-l5n94

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w2-b59563-openshift-default-dockercfg-h4q7c); attempting to pull the image may not succeed.
(x3)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

ProbeError

Startup probe error: Get "http://10.132.1.109:15021/healthz/ready": dial tcp 10.132.1.109:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-worker-w2-b59563-openshift-default-6df66b7897-hwhwq

Unhealthy

Startup probe failed: Get "http://10.132.1.109:15021/healthz/ready": dial tcp 10.132.1.109:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-9360eb-openshift-default-6b47969f67-mf5tm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-e863e405

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e863e405

openshift-ingress

deployment-controller

e2e-ait-e863e405-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e863e405-openshift-default-678bb86885 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-e863e405-openshift-default-678bb86885

SuccessfulCreate

Created pod: e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

openshift-ingress

multus

e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

AddedInterface

Add eth0 [10.132.1.110/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e863e405-b4bdcb495

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e863e405-b4bdcb495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e863e405: serviceaccount "payload-processing-e2e-ait-e863e405" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e863e405

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e863e405

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e863e405-b4bdcb495 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-hr6hb
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e863e405: serviceaccount "payload-processing-e2e-ait-e863e405" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-hr6hb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-hr6hb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-e863e405-b4bdcb495-55jgq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-hr6hb

AddedInterface

Add eth0 [10.132.1.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e863e405-b4bdcb495-55jgq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-e863e405-b4bdcb495-55jgq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-e863e405-b4bdcb495-55jgq

AddedInterface

Add eth0 [10.132.1.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-hr6hb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e863e405-b4bdcb495

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e863e405-b4bdcb495-55jgq
(x2)

openshift-ingress

kubelet

e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

ProbeError

Startup probe error: Get "http://10.132.1.110:15021/healthz/ready": dial tcp 10.132.1.110:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

Unhealthy

Startup probe failed: Get "http://10.132.1.110:15021/healthz/ready": dial tcp 10.132.1.110:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e863e405-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e863e405-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e863e405-6c6bdc45c9-hr6hb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e863e405-b4bdcb495-55jgq

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e863e405-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e863e405-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-e863e405-openshift-default-678bb86885-cv9bb

Killing

Stopping container istio-proxy

opendatahub

replicaset-controller

maas-controller-7c946769f6

SuccessfulDelete

Deleted pod: maas-controller-7c946769f6-k59sv

opendatahub

kubelet

maas-controller-7c946769f6-k59sv

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-7c946769f6

SuccessfulCreate

Created pod: maas-controller-7c946769f6-7vw7l

opendatahub

kubelet

maas-controller-7c946769f6-7vw7l

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:a2feb5b4c34bf082ebc90c7906eea6aa0d70053da5b81e9eb6106962997f1de2"

opendatahub

multus

maas-controller-7c946769f6-7vw7l

AddedInterface

Add eth0 [10.132.1.115/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7c946769f6-7vw7l

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:a2feb5b4c34bf082ebc90c7906eea6aa0d70053da5b81e9eb6106962997f1de2" in 1.062s (1.062s including waiting). Image size: 200094743 bytes.

opendatahub

kubelet

maas-controller-7c946769f6-7vw7l

Started

Container started

opendatahub

kubelet

maas-controller-7c946769f6-7vw7l

Created

Container created

opendatahub

maas-controller-7c946769f6-7vw7l_5096dd52-06a2-44b9-9c87-a1d235f1b521

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7c946769f6-7vw7l_5096dd52-06a2-44b9-9c87-a1d235f1b521 became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-wlt76

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-wlt76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h4vrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h4vrf

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-nhf4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-h4vrf

AddedInterface

Add eth0 [10.132.1.117/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-nhf4g

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-wlt76

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-nhf4g

AddedInterface

Add eth0 [10.132.1.118/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-nhf4g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h4vrf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-wlt76

Created

Container created

opendatahub

replicaset-controller

maas-controller-7c946769f6

SuccessfulDelete

Deleted pod: maas-controller-7c946769f6-7vw7l

opendatahub

kubelet

maas-controller-7c946769f6-7vw7l

Killing

Stopping container manager
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7c946769f6 from 1 to 0

opendatahub

replicaset-controller

maas-controller-7c946769f6

SuccessfulCreate

Created pod: maas-controller-7c946769f6-6pgn5
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7c946769f6 from 0 to 1

opendatahub

multus

maas-controller-7c946769f6-6pgn5

AddedInterface

Add eth0 [10.132.1.119/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7c946769f6-6pgn5

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:a2feb5b4c34bf082ebc90c7906eea6aa0d70053da5b81e9eb6106962997f1de2"

opendatahub

kubelet

maas-controller-7c946769f6-6pgn5

Started

Container started

opendatahub

kubelet

maas-controller-7c946769f6-6pgn5

Created

Container created

opendatahub

kubelet

maas-controller-7c946769f6-6pgn5

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:a2feb5b4c34bf082ebc90c7906eea6aa0d70053da5b81e9eb6106962997f1de2" in 885ms (885ms including waiting). Image size: 200094743 bytes.
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h4vrf

Unhealthy

Startup probe failed: Get "http://10.132.1.117:15021/healthz/ready": dial tcp 10.132.1.117:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-wlt76

Unhealthy

Startup probe failed: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-wlt76

ProbeError

Startup probe error: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h4vrf

ProbeError

Startup probe error: Get "http://10.132.1.117:15021/healthz/ready": dial tcp 10.132.1.117:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-nhf4g

Unhealthy

Startup probe failed: Get "http://10.132.1.118:15021/healthz/ready": dial tcp 10.132.1.118:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-nhf4g

ProbeError

Startup probe error: Get "http://10.132.1.118:15021/healthz/ready": dial tcp 10.132.1.118:15021: connect: connection refused body:
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 6 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6886b96f9

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6886b96f9-ddzvr
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ddzvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-ddzvr

AddedInterface

Add eth0 [10.132.1.120/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-9sp48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-9sp48

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ddzvr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-9sp48

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ddzvr

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-9sp48

AddedInterface

Add eth0 [10.133.0.201/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-9sp48

Unhealthy

Startup probe failed: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ddzvr

ProbeError

Startup probe error: Get "http://10.132.1.120:15021/healthz/ready": dial tcp 10.132.1.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ddzvr

Unhealthy

Startup probe failed: Get "http://10.132.1.120:15021/healthz/ready": dial tcp 10.132.1.120:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-9sp48

ProbeError

Startup probe error: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused body:

opendatahub

maas-controller-7c946769f6-6pgn5_5c4b2b87-d85f-44b0-8be5-82c0bc2d1027

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7c946769f6-6pgn5_5c4b2b87-d85f-44b0-8be5-82c0bc2d1027 became leader
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 8 to 10
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-5smg5

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6886b96f9-lqmhm

AddedInterface

Add eth0 [10.132.1.122/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

ProbeError

Startup probe error: Get "http://10.132.1.122:15021/healthz/ready": dial tcp 10.132.1.122:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

Unhealthy

Startup probe failed: Get "http://10.132.1.122:15021/healthz/ready": dial tcp 10.132.1.122:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

Unhealthy

Startup probe failed: Get "http://10.132.1.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

ProbeError

Startup probe error: Get "http://10.132.1.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.Service llm/e2e-prio-pool-7010fecc-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.Deployment llm/e2e-prio-pool-7010fecc-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.Secret llm/e2e-prio-pool-7010fecc-kserve-self-signed-certs

llm

replicaset-controller

e2e-prio-pool-7010fecc-kserve-587655c754

SuccessfulCreate

Created pod: e2e-prio-pool-7010fecc-kserve-587655c754-zr7gl

llm

deployment-controller

e2e-prio-pool-7010fecc-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-7010fecc-kserve-587655c754 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.Deployment llm/e2e-prio-pool-7010fecc-kserve-router-scheduler

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-7010fecc-epp-auth-rb

llm

multus

e2e-prio-pool-7010fecc-kserve-587655c754-zr7gl

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.Service llm/e2e-prio-pool-7010fecc-epp-service

llm

kubelet

e2e-prio-pool-7010fecc-kserve-587655c754-zr7gl

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

replicaset-controller

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7

SuccessfulCreate

Created pod: e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.RoleBinding llm/e2e-prio-pool-7010fecc-epp-rb

llm

deployment-controller

e2e-prio-pool-7010fecc-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.ServiceAccount llm/e2e-prio-pool-7010fecc-epp-sa

llm

kubelet

e2e-prio-pool-7010fecc-kserve-587655c754-zr7gl

Created

Container created

llm

kubelet

e2e-prio-pool-7010fecc-kserve-587655c754-zr7gl

Started

Container started

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

Created v1.Role llm/e2e-prio-pool-7010fecc-epp-role

llm

multus

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

AddedInterface

Add eth0 [10.132.1.126/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Updated

Updated v1.Secret llm/e2e-prio-pool-7010fecc-kserve-self-signed-certs

llm

kubelet

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

Created

Container created

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-7010fecc-kserve-route
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-7010fecc-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

Started

Container started

llm

kubelet

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 2.14s (2.14s including waiting). Image size: 184206420 bytes.

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-7010fecc] is Ready

llm

LLMInferenceServiceController

e2e-prio-pool-7010fecc

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-7010fecc-epp-auth-rb

llm

kubelet

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-7010fecc-kserve-587655c754-zr7gl

Killing

Stopping container main

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-bbc981

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-bbc981

openshift-ingress

replicaset-controller

e2e-worker-single-main-bbc981-openshift-default-7545c598f7

SuccessfulCreate

Created pod: e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

openshift-ingress

deployment-controller

e2e-worker-single-main-bbc981-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-bbc981-openshift-default-7545c598f7 from 0 to 1

openshift-ingress

multus

e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-bbc981

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-bbc981-59b4b57c5f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-bbc981

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-bbc981-7fd54db94f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-bbc981-7fd54db94f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-bbc981-7fd54db94f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-bbc981: serviceaccount "payload-processing-e2e-worker-single-main-bbc981" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-bbc981-59b4b57c5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-bbc981-59b4b57c5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-bbc981-59b4b57c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-bbc981: serviceaccount "payload-processing-e2e-worker-single-main-bbc981" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-bbc981-7fd54db94f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr
(x5)

llm

kubelet

e2e-prio-pool-7010fecc-kserve-router-scheduler-5b498b48f7-bkf6x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-bbc981-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-bbc981-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

ProbeError

Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

Unhealthy

Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-bbc981-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-bbc981-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-bbc981-7fd54db94ftpxr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-bbc981-59b4bqbkl4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-single-main-bbc981-openshift-default-7545c598f76d2dc

Killing

Stopping container istio-proxy

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Created

Created v1.Secret llm/e2e-same-id-a-12997f0c-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Created

Created v1.Deployment llm/e2e-same-id-a-12997f0c-kserve

llm

kubelet

e2e-same-id-a-12997f0c-kserve-6686955949-lf42k

Started

Container started

llm

kubelet

e2e-same-id-a-12997f0c-kserve-6686955949-lf42k

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Created

Created v1.Service llm/e2e-same-id-a-12997f0c-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Created

Created v1.PodMonitor llm/e2e-same-id-a-12997f0c-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Created

Created v1.PodMonitor llm/e2e-same-id-a-12997f0c-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Created

Created v1.HTTPRoute llm/e2e-same-id-a-12997f0c-kserve-route

llm

kubelet

e2e-same-id-a-12997f0c-kserve-6686955949-lf42k

Created

Container created

llm

deployment-controller

e2e-same-id-a-12997f0c-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-12997f0c-kserve-6686955949 from 0 to 1

llm

replicaset-controller

e2e-same-id-a-12997f0c-kserve-6686955949

SuccessfulCreate

Created pod: e2e-same-id-a-12997f0c-kserve-6686955949-lf42k

llm

multus

e2e-same-id-a-12997f0c-kserve-6686955949-lf42k

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Created

Created v1.DestinationRule llm/e2e-same-id-a-12997f0c-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-12997f0c-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

Updated

Updated v1.Secret llm/e2e-same-id-a-12997f0c-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-12997f0c] is Ready

llm

multus

e2e-same-id-b-12997f0c-kserve-79fdf5d98f-28768

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Created

Created v1.Service llm/e2e-same-id-b-12997f0c-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Created

Created v1.HTTPRoute llm/e2e-same-id-b-12997f0c-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Created

Created v1.DestinationRule llm/e2e-same-id-b-12997f0c-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Created

Created v1.PodMonitor llm/e2e-same-id-b-12997f0c-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Created

Created v1.PodMonitor llm/e2e-same-id-b-12997f0c-kserve-llmisvc-engine

llm

kubelet

e2e-same-id-b-12997f0c-kserve-79fdf5d98f-28768

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

replicaset-controller

e2e-same-id-b-12997f0c-kserve-79fdf5d98f

SuccessfulCreate

Created pod: e2e-same-id-b-12997f0c-kserve-79fdf5d98f-28768

llm

deployment-controller

e2e-same-id-b-12997f0c-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-12997f0c-kserve-79fdf5d98f from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Created

Created v1.Secret llm/e2e-same-id-b-12997f0c-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Created

Created v1.Deployment llm/e2e-same-id-b-12997f0c-kserve

llm

kubelet

e2e-same-id-b-12997f0c-kserve-79fdf5d98f-28768

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-12997f0c-prometheus-scraping

llm

kubelet

e2e-same-id-b-12997f0c-kserve-79fdf5d98f-28768

Created

Container created

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

Updated

Updated v1.Secret llm/e2e-same-id-b-12997f0c-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-12997f0c] is Ready
(x3)

llm

LLMInferenceServiceController

e2e-same-id-a-12997f0c

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-12997f0c in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-12997f0c; safe to ignore if traffic splitting is planned
(x5)

llm

LLMInferenceServiceController

e2e-same-id-b-12997f0c

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-12997f0c in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-12997f0c; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-12997f0c-kserve-6686955949-lf42k

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-12997f0c-kserve-79fdf5d98f-28768

Killing

Stopping container main

openshift-ingress

replicaset-controller

payload-pre-processing-6545dbfb5c

SuccessfulCreate

Created pod: payload-pre-processing-6545dbfb5c-prvtw

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6545dbfb5c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-6545dbfb5c-prvtw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-6545dbfb5c-prvtw

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-6545dbfb5c-prvtw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-6545dbfb5c-prvtw

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-9pzbs

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9pzbs

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-597dbd485d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-597dbd485d

SuccessfulCreate

Created pod: payload-processing-597dbd485d-sbjjw

openshift-ingress

multus

payload-processing-597dbd485d-sbjjw

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-597dbd485d-sbjjw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-597dbd485d-sbjjw

Created

Container created

openshift-ingress

kubelet

payload-processing-597dbd485d-sbjjw

Started

Container started

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-k2qfn

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-k2qfn

openshift-ingress

replicaset-controller

payload-processing-79468f7c9f

SuccessfulCreate

Created pod: payload-processing-79468f7c9f-559sl

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-79468f7c9f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-9cfb9b656

SuccessfulCreate

Created pod: payload-pre-processing-9cfb9b656-jtls9

openshift-ingress

kubelet

payload-processing-79468f7c9f-559sl

Started

Container started

openshift-ingress

kubelet

payload-processing-79468f7c9f-559sl

Created

Container created

openshift-ingress

kubelet

payload-processing-79468f7c9f-559sl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-79468f7c9f-559sl

AddedInterface

Add eth0 [10.133.0.212/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-9cfb9b656 from 0 to 1

openshift-ingress

multus

payload-pre-processing-9cfb9b656-jtls9

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-9cfb9b656-jtls9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-9cfb9b656-jtls9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-9cfb9b656-jtls9

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-597dbd485d

SuccessfulDelete

Deleted pod: payload-processing-597dbd485d-sbjjw

openshift-ingress

kubelet

payload-processing-597dbd485d-sbjjw

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-597dbd485d from 1 to 0

openshift-ingress

replicaset-controller

payload-pre-processing-6545dbfb5c

SuccessfulDelete

Deleted pod: payload-pre-processing-6545dbfb5c-prvtw

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-6545dbfb5c from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-6545dbfb5c-prvtw

Killing

Stopping container payload-pre-processing
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-lqzd2

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-lqzd2

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-lqzd2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-lqzd2

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5bcd7997-lqzd2

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-lqzd2

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-single-main-cc1991-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-cc1991-openshift-default-546d4d6df7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7

SuccessfulCreate

Created pod: e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-cc1991

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-cc1991

openshift-ingress

multus

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

AddedInterface

Add eth0 [10.132.1.145/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-cc1991

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-cc1991-69cc9cc999 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-cc1991

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-cc1991-6f7b98874c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-cc1991-6f7b98874c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-cc1991-69cc9cc999

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-cc1991-69cc9cc999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-cc1991: serviceaccount "payload-processing-e2e-worker-single-main-cc1991" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-cc1991-69cc9cc999

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-cc1991-6f7b98874c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-cc1991-6f7b98874c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-cc1991: serviceaccount "payload-processing-e2e-worker-single-main-cc1991" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-cc1991-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-cc1991-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

ProbeError

Startup probe error: Get "http://10.132.1.145:15021/healthz/ready": dial tcp 10.132.1.145:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

Unhealthy

Startup probe failed: Get "http://10.132.1.145:15021/healthz/ready": dial tcp 10.132.1.145:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-cc1991-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-cc1991-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-cc1991-6f7b988744n88j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-cc1991-69cc955kxb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-single-main-cc1991-openshift-default-546d4d6df7kw9nv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-ss2vc

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-ss2vc

Killing

Stopping container manager

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-4bvft

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-4bvft

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-4bvft

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-4bvft

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-4bvft

AddedInterface

Add eth0 [10.132.1.148/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-4bvft_0bbee95f-ed1c-4fcd-aafc-9f4e2456bf59

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-4bvft_0bbee95f-ed1c-4fcd-aafc-9f4e2456bf59 became leader
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-9sp48

Unhealthy

Readiness probe failed: Get "http://10.133.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-9sp48

ProbeError

Readiness probe error: Get "http://10.133.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ddzvr

Unhealthy

Readiness probe failed: Get "http://10.132.1.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-ddzvr

ProbeError

Readiness probe error: Get "http://10.132.1.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-6rp2d

ProbeError

Readiness probe error: Get "http://10.133.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-6rp2d

Unhealthy

Readiness probe failed: Get "http://10.133.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-wlt76

ProbeError

Readiness probe error: Get "http://10.134.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-wlt76

Unhealthy

Readiness probe failed: Get "http://10.134.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-nhf4g

ProbeError

Readiness probe error: Get "http://10.132.1.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h4vrf

ProbeError

Readiness probe error: Get "http://10.132.1.117:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-nhf4g

Unhealthy

Readiness probe failed: Get "http://10.132.1.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-h4vrf

Unhealthy

Readiness probe failed: Get "http://10.132.1.117:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

Unhealthy

Readiness probe failed: Get "http://10.132.1.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lqmhm

ProbeError

Readiness probe error: Get "http://10.132.1.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

Unhealthy

Readiness probe failed: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-5smg5

ProbeError

Readiness probe error: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bwzrc

Unhealthy

Readiness probe failed: Get "http://10.134.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-bwzrc

ProbeError

Readiness probe error: Get "http://10.134.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

Unhealthy

Readiness probe failed: Get "http://10.133.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6886b96f9-lxq9w

ProbeError

Readiness probe error: Get "http://10.133.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: