Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-549f9d654fgwg4f

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-549f9d654fgwg4f to ip-10-0-143-105.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-c54754479-qtnzb

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-c54754479-qtnzb to ip-10-0-143-105.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-c54754479-ctf8z

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-c54754479-ctf8z to ip-10-0-129-8.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-c54754479-2t99s

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-c54754479-2t99s to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z to ip-10-0-143-105.us-west-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-lvc7r

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-lvc7r to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn to ip-10-0-143-105.us-west-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-5cdlq

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-5cdlq to ip-10-0-129-8.us-west-2.compute.internal

opendatahub

test-curl-7292-ff3a7e

Scheduled

Successfully assigned opendatahub/test-curl-7292-ff3a7e to ip-10-0-129-8.us-west-2.compute.internal

opendatahub

test-curl-7292-e8494e

Scheduled

Successfully assigned opendatahub/test-curl-7292-e8494e to ip-10-0-132-173.us-west-2.compute.internal

opendatahub

test-curl-7292-a9d7ca

Scheduled

Successfully assigned opendatahub/test-curl-7292-a9d7ca to ip-10-0-132-173.us-west-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-vkpgs

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-vkpgs to ip-10-0-129-8.us-west-2.compute.internal

opendatahub

test-curl-7292-382c01

Scheduled

Successfully assigned opendatahub/test-curl-7292-382c01 to ip-10-0-132-173.us-west-2.compute.internal

opendatahub

test-curl-7292-123d75

Scheduled

Successfully assigned opendatahub/test-curl-7292-123d75 to ip-10-0-132-173.us-west-2.compute.internal

opendatahub

test-curl-7292-0d3744

Scheduled

Successfully assigned opendatahub/test-curl-7292-0d3744 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss to ip-10-0-132-173.us-west-2.compute.internal

opendatahub

test-curl-7289-da8265

Scheduled

Successfully assigned opendatahub/test-curl-7289-da8265 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6 to ip-10-0-132-173.us-west-2.compute.internal

opendatahub

test-curl-7289-997b79

Scheduled

Successfully assigned opendatahub/test-curl-7289-997b79 to ip-10-0-143-105.us-west-2.compute.internal

opendatahub

test-curl-7280-5cdc18

Scheduled

Successfully assigned opendatahub/test-curl-7280-5cdc18 to ip-10-0-129-8.us-west-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-rswdj

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-rswdj to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6 to ip-10-0-132-173.us-west-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-f2g2j

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-f2g2j to ip-10-0-129-8.us-west-2.compute.internal

opendatahub

odh-model-controller-769875db56-zcp2r

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-zcp2r to ip-10-0-129-8.us-west-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-h677g

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-h677g to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3c636f-openshift-default-8685f58797-ph54c to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9 to ip-10-0-132-173.us-west-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-86d5fddf5b-6j2ct

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-86d5fddf5b-6j2ct to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-api-b-e942ab-openshift-default-9c697d45-s727f

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e942ab-openshift-default-9c697d45-s727f to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr to ip-10-0-143-105.us-west-2.compute.internal

kuadrant-system

authorino-57f7f8659f-pjwds

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-pjwds to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj to ip-10-0-129-8.us-west-2.compute.internal

opendatahub

maas-controller-6685f84c75-8wmg2

Scheduled

Successfully assigned opendatahub/maas-controller-6685f84c75-8wmg2 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-blfp7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-blfp7 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-rlhnf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-rlhnf to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-x5kqt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-x5kqt to ip-10-0-143-105.us-west-2.compute.internal

kuadrant-system

authorino-5cff9fb997-zjfl9

Scheduled

Successfully assigned kuadrant-system/authorino-5cff9fb997-zjfl9 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-876pt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-876pt to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9 to ip-10-0-143-105.us-west-2.compute.internal

opendatahub

maas-controller-66859cdfc8-cjbxt

Scheduled

Successfully assigned opendatahub/maas-controller-66859cdfc8-cjbxt to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt to ip-10-0-143-105.us-west-2.compute.internal

kuadrant-system

authorino-5f7f7dc8cd-g96sp

Scheduled

Successfully assigned kuadrant-system/authorino-5f7f7dc8cd-g96sp to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

router-default-5cfd77cbdf-kcvgr

Scheduled

Successfully assigned openshift-ingress/router-default-5cfd77cbdf-kcvgr to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

router-default-5cfd77cbdf-kcvgr

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-5cfd77cbdf-kcvgr

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft to ip-10-0-129-8.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-vvv7j

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-vvv7j to ip-10-0-129-8.us-west-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-fjqs8

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-fjqs8 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5ctsx to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-bzn9w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bzn9w to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql to ip-10-0-143-105.us-west-2.compute.internal

kuadrant-system

authorino-c8d8fdbb7-65f6v

Scheduled

Successfully assigned kuadrant-system/authorino-c8d8fdbb7-65f6v to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-67865c945c-ffm6r

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-67865c945c-ffm6r to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8 to ip-10-0-129-8.us-west-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-wqmtl

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-wqmtl to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h to ip-10-0-132-173.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-rmwbn

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-rmwbn to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd to ip-10-0-129-8.us-west-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-9l4r5

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-9l4r5 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-9e4801-97fbd5b87-h2lzf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-9e4801-97fbd5b87-h2lzf to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-n4vgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-n4vgd to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-3f25cd-59987c57ff-949wh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-3f25cd-59987c57ff-949wh to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-add5bf-564b7f99c5-dhn9p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-add5bf-564b7f99c5-dhn9p to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-6cljj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-6cljj to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt to ip-10-0-129-8.us-west-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-zp68g

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-zp68g to ip-10-0-143-105.us-west-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-vjnhm

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-vjnhm to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-6zdb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7e6fe88b-558b6b9b97-6zdb2 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-qfvz7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-qfvz7 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-f6979f-78bd886898-gf67r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f6979f-78bd886898-gf67r to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-f6979f-65c8bd494f-hbt4m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f6979f-65c8bd494f-hbt4m to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-tcknv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-tcknv to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-nbc6x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-nbc6x to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx to ip-10-0-132-173.us-west-2.compute.internal

opendatahub

ai-gateway-controller-d6d549b95-zmcsl

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-d6d549b95-zmcsl to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-cb2b8a-7546789495-5wzmh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-cb2b8a-7546789495-5wzmh to ip-10-0-132-173.us-west-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-xq2lx

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-xq2lx to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-4p5pf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-4p5pf to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-66e263-f78d47599-bvgvd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-66e263-f78d47599-bvgvd to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f66180-794b84955-ndwz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f66180-794b84955-ndwz8 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-j7s55

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-j7s55 to ip-10-0-132-173.us-west-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-lh7sz

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-lh7sz to ip-10-0-132-173.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-6b4pn

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-6b4pn to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f1d081-7866949869-8hd89

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f1d081-7866949869-8hd89 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-srzhm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-srzhm to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-b647c3-5b5b948867-wzn9d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b647c3-5b5b948867-wzn9d to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd to ip-10-0-143-105.us-west-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-sl99p

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-sl99p to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-ac952a-676dc686ff-lzbkn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ac952a-676dc686ff-lzbkn to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-9332a5-b66fd5659-2ddd4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-9332a5-b66fd5659-2ddd4 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-mn6j9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-mn6j9 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-xr7cl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-xr7cl to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-d067bd-5f586dc769-w9w7j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d067bd-5f586dc769-w9w7j to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-c61da9-78dcc86799-qspwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-c61da9-78dcc86799-qspwl to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-3aca3f-554dd84857-59rv6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-3aca3f-554dd84857-59rv6 to ip-10-0-132-173.us-west-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-zh575

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-zh575 to ip-10-0-129-8.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-84cf56844-6pbmt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-84cf56844-6pbmt to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-qcr2l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-qcr2l to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-8ddd2c-6ffc4db587-f2g6h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-8ddd2c-6ffc4db587-f2g6h to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-6b5091-557fb7f58c-l8l7k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-6b5091-557fb7f58c-l8l7k to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw to ip-10-0-132-173.us-west-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-6k4fb

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-6k4fb to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v to ip-10-0-132-173.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-58d4f57fc5-wd9lt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-58d4f57fc5-wd9lt to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-3c636f-6948699f5-hhkc2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3c636f-6948699f5-hhkc2 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-31ae40-9cd8c58b9-6xlhm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-31ae40-9cd8c58b9-6xlhm to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-eee7f1-77669c5769-fr9zj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-eee7f1-77669c5769-fr9zj to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-8c2357-655589dfb7-9txvh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-8c2357-655589dfb7-9txvh to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-69a4bc-69465f7c7-kvvq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-69a4bc-69465f7c7-kvvq4 to ip-10-0-132-173.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-5747777fbb-w572x

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5747777fbb-w572x to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-95fa4445-f8bcbf959-8qrhg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-95fa4445-f8bcbf959-8qrhg to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-24d78330-867bff44fc-xljll

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-24d78330-867bff44fc-xljll to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7 to ip-10-0-129-8.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-5747777fbb-6hbdx

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5747777fbb-6hbdx to ip-10-0-143-105.us-west-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-jqgc5

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-jqgc5 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-67865c945c-w5smw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-67865c945c-w5smw to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-j9vgx

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-j9vgx to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f to ip-10-0-143-105.us-west-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-zdlfm

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-zdlfm to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-d4s6f

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-d4s6f to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-fk527

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-fk527 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-hvt6d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hvt6d to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-kj5vp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-kj5vp to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-pqv5l to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw to ip-10-0-132-173.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-56f84cd566-gzxbm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-56f84cd566-gzxbm to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-r7hr5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-r7hr5 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5 to ip-10-0-143-105.us-west-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-qpkjl

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-qpkjl to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-rr5k6 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-sf86p

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-sf86p to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-z2grb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-z2grb to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-95cb67c75-pqzdj

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-95cb67c75-pqzdj to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt to ip-10-0-143-105.us-west-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-zk45d

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-zk45d to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-r2x25

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-r2x25 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-kdx2l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-kdx2l to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-xbpcl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-xbpcl to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-9xcfc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-9xcfc to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-5gwjd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-5gwjd to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-jxkks

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-jxkks to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph to ip-10-0-143-105.us-west-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82bqnm

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82bqnm to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-kx6wj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-kx6wj to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-rrbs6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-rrbs6 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-bdr88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-bdr88 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-qqfk7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-qqfk7 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-6b5091-755985cf47-tf5vq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-6b5091-755985cf47-tf5vq to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6 to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-pfjc2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-pfjc2 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-lkxlp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-lkxlp to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-hwmd2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-hwmd2 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-96cr9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-96cr9 to ip-10-0-143-105.us-west-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-mfrb7

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-mfrb7 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-22k9f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-22k9f to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-jrt8z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-jrt8z to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-7wb2p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-7wb2p to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-noten-c32349-openshift-default-848479bc65-mghjd

Scheduled

Successfully assigned openshift-ingress/e2e-noten-c32349-openshift-default-848479bc65-mghjd to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-l4x5f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-l4x5f to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-hdzd6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-hdzd6 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-s999b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-s999b to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b647c3-799446d767-7g2mp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b647c3-799446d767-7g2mp to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-46qzr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-46qzr to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-xm4lr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-xm4lr to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f66180-84487bc787-gjmlg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f66180-84487bc787-gjmlg to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-t5b4n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-t5b4n to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5 to ip-10-0-132-173.us-west-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-8mnf5

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-8mnf5 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-cb5r2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-cb5r2 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-g6gxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-g6gxl to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-mn7lf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-mn7lf to ip-10-0-143-105.us-west-2.compute.internal

cert-manager

cert-manager-597b95cb84-7pvnx

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-7pvnx to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-d52gg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-d52gg to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx to ip-10-0-129-8.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-9zl2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-9zl2n to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-4rfrk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-4rfrk to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-gmkpn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-gmkpn to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-n5nw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-n5nw5 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-lrjn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-lrjn5 to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f66180-85458794b8-hw7f5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f66180-85458794b8-hw7f5 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds to ip-10-0-132-173.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-b687k

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b687k to ip-10-0-143-105.us-west-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2 to ip-10-0-143-105.us-west-2.compute.internal

openshift-ingress

replicaset-controller

router-default-5cfd77cbdf

SuccessfulCreate

Created pod: router-default-5cfd77cbdf-kcvgr

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5cfd77cbdf from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-5cfd77cbdf-kcvgr

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-5cfd77cbdf-kcvgr

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-5cfd77cbdf-kcvgr

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5cfd77cbdf-kcvgr

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-5cfd77cbdf-kcvgr

Created

Container created

openshift-ingress

kubelet

router-default-5cfd77cbdf-kcvgr

Started

Container started

openshift-ingress

kubelet

router-default-5cfd77cbdf-kcvgr

ProbeError

Startup probe error: HTTP probe failed with statuscode: 500 body: [-]backend-proxy-http failed: reason withheld [+]has-synced ok [+]process-running ok healthz check failed

openshift-ingress

kubelet

router-default-5cfd77cbdf-kcvgr

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 500

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-876pt

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-876pt

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.584s (4.584s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-pqv5l

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-95cb67c75

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-95cb67c75-pqzdj

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-95cb67c75 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-95cb67c75-pqzdj

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-pqv5l

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-pqzdj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-pqzdj

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-pqzdj

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-pqzdj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.46s (7.46s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.656s (8.656s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-c54754479 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-c54754479

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-c54754479-ctf8z

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-c54754479

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-c54754479-2t99s

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-c54754479

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-c54754479-qtnzb

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-2t99s

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-c54754479-2t99s

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-c54754479-ctf8z

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-ctf8z

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-c54754479-qtnzb

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-qtnzb

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

install-dfcjr

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-2t99s

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-2t99s

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.872s (3.872s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-ctf8z

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-qtnzb

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-qtnzb

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-qtnzb

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.129s (4.129s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-ctf8z

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.511s (3.511s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-ctf8z

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-2t99s

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-ctf8z

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-2t99s

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-ctf8z

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-ctf8z

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 952ms (952ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-ctf8z

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-qtnzb

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-2t99s

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 911ms (911ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-2t99s

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-qtnzb

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-2t99s

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-qtnzb

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-c54754479-qtnzb

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 920ms (920ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-c54754479-ctf8z_86d8caed-7dd2-48b9-a2a0-5c7b7bac7f01

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-c54754479-ctf8z_86d8caed-7dd2-48b9-a2a0-5c7b7bac7f01 became leader

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-wqmtl

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-wqmtl

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-wqmtl

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-wqmtl

Started

Container started

kuadrant-system

authorino-operator-7b7bb4bc77-wqmtl_46cfc59f-b85e-4310-80a4-7bd7bd6a3db8

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-wqmtl_46cfc59f-b85e-4310-80a4-7bd7bd6a3db8 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-wqmtl

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-wqmtl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 5.218s (5.219s including waiting). Image size: 167738465 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rswdj

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-rswdj

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-6b4pn

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-rswdj

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-6b4pn

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-6b4pn

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-6k4fb

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-6k4fb

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6k4fb

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rswdj

Created

Container created

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-vkpgs

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rswdj

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 5.266s (5.266s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rswdj

Started

Container started

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-rswdj_48128b0b-7713-43c8-a89b-ee0239212133 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-vkpgs

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vkpgs

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-lvc7r

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-6b4pn_32e84608-693c-4f7b-8d93-9d5acd25966c

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-6b4pn_32e84608-693c-4f7b-8d93-9d5acd25966c became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-6b4pn

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-6b4pn

Started

Container started

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-zp68g

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-6b4pn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 6.333s (6.333s including waiting). Image size: 424244516 bytes.

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-lvc7r

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-lvc7r

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6k4fb

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6k4fb

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-zp68g

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6k4fb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 3.203s (3.203s including waiting). Image size: 177967631 bytes.

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-zp68g

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

limitador-operator-controller-manager-5778bb4449-6k4fb_aaa129e1-374e-42f4-ada7-5949da96d2bc

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-6k4fb_aaa129e1-374e-42f4-ada7-5949da96d2bc became leader

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xq2lx

FailedMount

MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-xq2lx

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-lvc7r

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vkpgs

Created

Container created

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vkpgs

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-lvc7r

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.438s (4.438s including waiting). Image size: 309650901 bytes.

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-xq2lx

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vkpgs

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.868s (5.868s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-lvc7r

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-zp68g

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-zp68g

Created

Container created
(x9)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xq2lx

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-zp68g

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 4.629s (4.629s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-zp68g_3f827f78-c3e7-4923-a500-5b60257d23fe

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-zp68g_3f827f78-c3e7-4923-a500-5b60257d23fe became leader

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-7pvnx

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

cert-manager

kubelet

cert-manager-597b95cb84-7pvnx

Started

Container started

cert-manager

multus

cert-manager-597b95cb84-7pvnx

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

cert-manager

kubelet

cert-manager-597b95cb84-7pvnx

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

cert-manager

kubelet

cert-manager-597b95cb84-7pvnx

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-67865c945c

SuccessfulCreate

Created pod: kube-auth-proxy-67865c945c-w5smw

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-67865c945c from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-67865c945c

SuccessfulCreate

Created pod: kube-auth-proxy-67865c945c-ffm6r

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-sl99p

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-549f9d654f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-549f9d654fgwg4f

openshift-ingress

multus

kube-auth-proxy-67865c945c-w5smw

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-549f9d654f from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-w5smw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sl99p

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-ffm6r

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing
(x3)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

multus

limitador-limitador-74dfcfb894-sl99p

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fgwg4f

Started

Container started

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-pjwds

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fgwg4f

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-549f9d654fgwg4f

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-67865c945c-ffm6r

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

multus

authorino-57f7f8659f-pjwds

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-ffm6r

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fgwg4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-57f7f8659f-pjwds

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xq2lx

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xq2lx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.691s (6.691s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xq2lx

Created

Container created

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-f2g2j

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-zh575

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-ffm6r

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-w5smw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.469s (3.469s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-w5smw

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-w5smw

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-ffm6r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.721s (3.721s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

authorino-56c6c9ddd5-f2g2j

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-67865c945c-ffm6r

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-zh575

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-7c9b87d574-zh575

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-f2g2j

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-57f7f8659f-pjwds

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sl99p

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 5.021s (5.021s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sl99p

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sl99p

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-pjwds

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-pjwds

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.643s (3.643s including waiting). Image size: 204096810 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-zh575

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-f2g2j

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.723s (3.723s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-f2g2j

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-f2g2j

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-zh575

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.819s (3.819s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-zh575

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-pjwds

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-pjwds

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-k52q7"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-6vbf4"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-86d5fddf5b

SuccessfulCreate

Created pod: jobset-controller-manager-86d5fddf5b-6j2ct

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-86d5fddf5b from 0 to 1

openshift-jobset-operator

multus

jobset-controller-manager-86d5fddf5b-6j2ct

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-86d5fddf5b-6j2ct

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-sl99p

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sl99p

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

openshift-jobset-operator

kubelet

jobset-controller-manager-86d5fddf5b-6j2ct

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-86d5fddf5b-6j2ct

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-86d5fddf5b-6j2ct

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 6.366s (6.366s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

jobset-controller-manager-86d5fddf5b-6j2ct_0b475599-8f66-43a3-a5c5-c60076fa0cf0

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-86d5fddf5b-6j2ct_0b475599-8f66-43a3-a5c5-c60076fa0cf0 became leader

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-9l4r5

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-9l4r5

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-9l4r5

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-9l4r5

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-9l4r5

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-9l4r5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 3.175s (3.175s including waiting). Image size: 195729000 bytes.

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

maas-controller-6685f84c75

SuccessfulCreate

Created pod: maas-controller-6685f84c75-8wmg2

opendatahub

multus

maas-controller-66859cdfc8-cjbxt

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-66859cdfc8 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-6685f84c75 from 0 to 1

opendatahub

kubelet

maas-controller-66859cdfc8-cjbxt

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:fe4bd0d7cdd1cfb8cbce19cd8c68adc9b1a09d9153c15cf3222203c943fd7118"

opendatahub

kserve-module-controller-manager-7566cf5fc8-9l4r5_b1b1227d-7592-464a-a992-d9772d78ecbc

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-9l4r5_b1b1227d-7592-464a-a992-d9772d78ecbc became leader

opendatahub

replicaset-controller

maas-controller-66859cdfc8

SuccessfulCreate

Created pod: maas-controller-66859cdfc8-cjbxt

opendatahub

multus

maas-controller-6685f84c75-8wmg2

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Failed

Error: ErrImagePull

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Failed

Failed to pull image "quay.io/opendatahub/maas-controller@sha256:fe4bd0d7cdd1cfb8cbce19cd8c68adc9b1a09d9153c15cf3222203c943fd7118": unable to pull image: copying system image from manifest list: parsing image configuration: Get "https://cdn01.quay.io/quayio-production-s3/sha256/3a/3a914942e67880a01f9e852006dce0a26dcad1ee82cb3bbda1129fca49ddd887?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261031%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261031T003428Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=69f052d2fdd4a4042c9a49a39ba3465c837768d213493b7928e6c89d79a4efc3&region=us-east-1&namespace=opendatahub&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=maas-controller&akamai_signature=exp=1793407768~hmac=f8f4d2881e049de712b5f289e4e095e91e284a51539f42e5344895f877d1f8f7": EOF

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Failed

Error: ImagePullBackOff

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

BackOff

Back-off pulling image "quay.io/opendatahub/maas-controller@sha256:fe4bd0d7cdd1cfb8cbce19cd8c68adc9b1a09d9153c15cf3222203c943fd7118"

opendatahub

kubelet

maas-controller-66859cdfc8-cjbxt

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:fe4bd0d7cdd1cfb8cbce19cd8c68adc9b1a09d9153c15cf3222203c943fd7118" in 7.263s (7.263s including waiting). Image size: 200054807 bytes.

opendatahub

kubelet

maas-controller-66859cdfc8-cjbxt

Created

Container created

opendatahub

kubelet

maas-controller-66859cdfc8-cjbxt

Started

Container started

opendatahub

maas-controller-66859cdfc8-cjbxt_6ae2e61d-6029-4ff7-a137-08512e4b07c9

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-66859cdfc8-cjbxt_6ae2e61d-6029-4ff7-a137-08512e4b07c9 became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-5cdlq

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-5cdlq

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-5cdlq

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-5cdlq

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:fe4bd0d7cdd1cfb8cbce19cd8c68adc9b1a09d9153c15cf3222203c943fd7118" in 3.47s (3.47s including waiting). Image size: 200054807 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-5cdlq

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-5cdlq

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 14.361s (14.361s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-5cdlq

Started

Container started

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-66859cdfc8 from 1 to 0

opendatahub

kubelet

maas-controller-66859cdfc8-cjbxt

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-66859cdfc8

SuccessfulDelete

Deleted pod: maas-controller-66859cdfc8-cjbxt

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-bzn9w

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bzn9w

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-bzn9w

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bzn9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bzn9w

Started

Container started
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bzn9w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bzn9w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-h677g

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-zcp2r

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-vjnhm

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

ProbeError

Readiness probe error: Get "http://10.134.0.20:8080/ready": dial tcp 10.134.0.20:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-876pt

Unhealthy

Readiness probe failed: Get "http://10.134.0.20:8080/ready": dial tcp 10.134.0.20:8080: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-876pt

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-vvv7j

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

multus

model-serving-api-75bd89fdfc-h677g

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-vjnhm

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-vjnhm

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

odh-model-controller-769875db56-zcp2r

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-zcp2r

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-vvv7j

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vvv7j

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

model-serving-api-75bd89fdfc-h677g

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vvv7j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.018s (3.018s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-vjnhm

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.228s (3.228s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-h677g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.97s (2.97s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-h677g

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-h677g

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vvv7j

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-vjnhm

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-vjnhm

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vvv7j

Created

Container created

opendatahub

maas-controller-6685f84c75-8wmg2_7573ffa9-3403-496c-b832-4b6df3d6330d

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6685f84c75-8wmg2_7573ffa9-3403-496c-b832-4b6df3d6330d became leader

opendatahub

kserve-controller-manager-776cc66d47-vjnhm_6f22fc6a-de9c-44bf-b0d2-5822554049db

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-vjnhm_6f22fc6a-de9c-44bf-b0d2-5822554049db became leader

opendatahub

kubelet

odh-model-controller-769875db56-zcp2r

Created

Container created

opendatahub

llmisvc-controller-manager-869d5dcc5d-vvv7j_dc6d2503-d7b2-4d1e-b444-8b0868b3e6b4

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-vvv7j_dc6d2503-d7b2-4d1e-b444-8b0868b3e6b4 became leader

opendatahub

kubelet

odh-model-controller-769875db56-zcp2r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 5.241s (5.242s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-zcp2r

Started

Container started

opendatahub

odh-model-controller-769875db56-zcp2r_2178cc57-22b6-4309-bf32-83b306827409

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-zcp2r_2178cc57-22b6-4309-bf32-83b306827409 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-c8d8fdbb7 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-fjqs8

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-c8d8fdbb7

SuccessfulCreate

Created pod: authorino-c8d8fdbb7-65f6v

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-fjqs8

kuadrant-system

kubelet

authorino-6f6944bcdd-fjqs8

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-5cff9fb997

SuccessfulCreate

Created pod: authorino-5cff9fb997-zjfl9

kuadrant-system

multus

authorino-6f6944bcdd-fjqs8

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-c8d8fdbb7-65f6v

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-5cff9fb997 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-c8d8fdbb7 from 1 to 0

kuadrant-system

multus

authorino-c8d8fdbb7-65f6v

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

multus

authorino-5cff9fb997-zjfl9

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-c8d8fdbb7

SuccessfulDelete

Deleted pod: authorino-c8d8fdbb7-65f6v

kuadrant-system

kubelet

authorino-5cff9fb997-zjfl9

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-c8d8fdbb7-65f6v

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.662s (1.662s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-fjqs8

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-fjqs8

Started

Container started

kuadrant-system

kubelet

authorino-c8d8fdbb7-65f6v

Started

Container started

kuadrant-system

kubelet

authorino-c8d8fdbb7-65f6v

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Started

Container started

kuadrant-system

kubelet

authorino-5cff9fb997-zjfl9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.494s (1.494s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-fjqs8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.833s (1.833s including waiting). Image size: 204096810 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Created

Container created

kuadrant-system

kubelet

authorino-5cff9fb997-zjfl9

Started

Container started

kuadrant-system

kubelet

authorino-5cff9fb997-zjfl9

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

authorino-6f6944bcdd-fjqs8

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-c8d8fdbb7-65f6v

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-f2g2j

kuadrant-system

kubelet

authorino-56c6c9ddd5-f2g2j

Killing

Stopping container authorino
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-rmwbn

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rmwbn

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-rmwbn

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rmwbn

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rmwbn

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rmwbn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 780ms (780ms including waiting). Image size: 235100981 bytes.
(x6)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vvv7j

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-vvv7j

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lh7sz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-lh7sz

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-lh7sz

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lh7sz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.505s (2.505s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lh7sz

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lh7sz

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-lh7sz_14a77f0f-44ca-4c20-862f-6bf5e7cd17fa

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-lh7sz_14a77f0f-44ca-4c20-862f-6bf5e7cd17fa became leader

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-j9vgx
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-9xcfc
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9xcfc

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-j9vgx

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-j9vgx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-9xcfc

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9xcfc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.178s (3.178s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-j9vgx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.261s (3.261s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-j9vgx

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-j9vgx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9xcfc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9xcfc

Created

Container created

opendatahub

multus

ai-gateway-controller-d6d549b95-zmcsl

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-d6d549b95 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-d6d549b95

SuccessfulCreate

Created pod: ai-gateway-controller-d6d549b95-zmcsl

opendatahub

llmisvc-controller-manager-6466c554d8-rmwbn_37cd224f-01b7-4e93-8c6b-e1e02d1ab587

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-rmwbn_37cd224f-01b7-4e93-8c6b-e1e02d1ab587 became leader

opendatahub

kubelet

ai-gateway-controller-d6d549b95-zmcsl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-d6d549b95-zmcsl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 989ms (989ms including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-d6d549b95-zmcsl

Created

Container created

opendatahub

kubelet

ai-gateway-controller-d6d549b95-zmcsl

Started

Container started

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Unhealthy

Readiness probe failed: Get "http://10.134.0.26:8081/readyz": dial tcp 10.134.0.26:8081: connect: connection refused
(x3)

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:fe4bd0d7cdd1cfb8cbce19cd8c68adc9b1a09d9153c15cf3222203c943fd7118"

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:fe4bd0d7cdd1cfb8cbce19cd8c68adc9b1a09d9153c15cf3222203c943fd7118" in 996ms (996ms including waiting). Image size: 200054807 bytes.
(x2)

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-6685f84c75-8wmg2

Created

Container created

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-lh7sz

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lh7sz

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

maas-controller-6685f84c75-8wmg2_b70e1876-b0df-4d68-b941-348f093a224e

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6685f84c75-8wmg2_b70e1876-b0df-4d68-b941-348f093a224e became leader

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-jqgc5

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-jqgc5

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-jqgc5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-jqgc5

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-jqgc5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.884s (1.884s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-jqgc5

Created

Container created

opendatahub

ai-gateway-controller-d6d549b95-zmcsl_17da78d4-326d-49b2-a107-cd445bf3d09d

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-d6d549b95-zmcsl_17da78d4-326d-49b2-a107-cd445bf3d09d became leader

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-zdlfm

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-zdlfm

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zdlfm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 597ms (597ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zdlfm

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zdlfm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zdlfm

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-qpkjl

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-qpkjl

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-qpkjl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-qpkjl

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-zk45d

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-qpkjl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.552s (1.552s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-qpkjl

Created

Container created

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-zk45d

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zk45d

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zk45d

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zk45d

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zk45d

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 616ms (616ms including waiting). Image size: 98346788 bytes.

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82bqnm

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82bqnm

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82bqnm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 606ms (606ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82bqnm

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82bqnm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82bqnm

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-mfrb7

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mfrb7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-mfrb7

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mfrb7

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mfrb7

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-mfrb7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.187s (2.187s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-8mnf5

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8mnf5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-8mnf5

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8mnf5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 595ms (595ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8mnf5

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8mnf5

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 596ms (596ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-rr5k6

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 1 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-rr5k6

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.736s (4.736s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-b687k

kuadrant-system

replicaset-controller

authorino-5f7f7dc8cd

SuccessfulCreate

Created pod: authorino-5f7f7dc8cd-g96sp

kuadrant-system

multus

authorino-5f7f7dc8cd-g96sp

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-fk527

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

kuadrant-system

kubelet

authorino-5f7f7dc8cd-g96sp

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fk527

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-b687k

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b687k

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-fk527

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b687k

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b687k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-5f7f7dc8cd-g96sp

Created

Container created

kuadrant-system

kubelet

authorino-5f7f7dc8cd-g96sp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.734s (1.734s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5f7f7dc8cd-g96sp

Started

Container started

kuadrant-system

kubelet

authorino-5cff9fb997-zjfl9

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-5cff9fb997

SuccessfulDelete

Deleted pod: authorino-5cff9fb997-zjfl9
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-5cff9fb997 from 1 to 0

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fk527

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fk527

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.014s (4.014s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fk527

Started

Container started
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b687k

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b687k

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fk527

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fk527

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-d6a47bf7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d6a47bf7

openshift-ingress

replicaset-controller

e2e-ait-24d78330-openshift-default-f7bc5cf4c

SuccessfulCreate

Created pod: e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

openshift-ingress

deployment-controller

e2e-ait-24d78330-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-24d78330-openshift-default-f7bc5cf4c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-24d78330

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-24d78330

openshift-ingress

gateway_labeler_controller

e2e-migrate-30d0c8aa-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-30d0c8aa-gw

openshift-ingress

deployment-controller

e2e-ait-d6a47bf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d6a47bf7-openshift-default-6bd8b956bc from 0 to 1

openshift-ingress

multus

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-30d0c8aa-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5 from 0 to 1

openshift-ingress

multus

e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc

SuccessfulCreate

Created pod: e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

openshift-ingress

replicaset-controller

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5

SuccessfulCreate

Created pod: e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

openshift-ingress

multus

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-95fa4445

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-95fa4445

openshift-ingress

deployment-controller

e2e-ait-95fa4445-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-95fa4445-openshift-default-c9bd77677 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-95fa4445-openshift-default-c9bd77677

SuccessfulCreate

Created pod: e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

openshift-ingress

multus

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-2b9202f4-openshift-default-6c7dcff65

SuccessfulCreate

Created pod: e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

openshift-ingress

gateway_labeler_controller

e2e-derive-2b9202f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2b9202f4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-30d0c8aa-7959895f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-30d0c8aa: serviceaccount "payload-processing-e2e-migrate-30d0c8aa" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-30d0c8aa: serviceaccount "payload-processing-e2e-migrate-30d0c8aa" not found

openshift-ingress

multus

e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-2b9202f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2b9202f4-openshift-default-6c7dcff65 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-30d0c8aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-30d0c8aa-7959895f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-30d0c8aa-7959895f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-lrjn5

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-30d0c8aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-qfvz7

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-lrjn5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-lrjn5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-qfvz7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-qfvz7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-lrjn5

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-qfvz7

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-qfvz7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-lrjn5

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-24d78330

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-24d78330-7d4499b8ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-24d78330-867bff44fc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-24d78330-867bff44fc-xljll
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-24d78330-867bff44fc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-24d78330-867bff44fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-24d78330: serviceaccount "payload-processing-e2e-ait-24d78330" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-24d78330

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-24d78330-867bff44fc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-24d78330: serviceaccount "payload-processing-e2e-ait-24d78330" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-24d78330-867bff44fc-xljll

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-24d78330-867bff44fc-xljll

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-24d78330-867bff44fc-xljll

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-24d78330-867bff44fc-xljll

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d6a47bf7: serviceaccount "payload-processing-e2e-ait-d6a47bf7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d6a47bf7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d6a47bf7: serviceaccount "payload-processing-e2e-ait-d6a47bf7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d6a47bf7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.283s (3.283s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 869ms (869ms including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 982ms (982ms including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ait-95fa4445

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-95fa4445-f8bcbf959 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-95fa4445-f8bcbf959

FailedCreate

Error creating: pods "payload-processing-e2e-ait-95fa4445-f8bcbf959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-95fa4445: serviceaccount "payload-processing-e2e-ait-95fa4445" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-95fa4445-bc5886d59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-95fa4445-f8bcbf959

SuccessfulCreate

Created pod: payload-processing-e2e-ait-95fa4445-f8bcbf959-8qrhg
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-95fa4445-bc5886d59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-95fa4445-bc5886d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-95fa4445: serviceaccount "payload-processing-e2e-ait-95fa4445" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-95fa4445

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-95fa4445-bc5886d59 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-95fa4445-f8bcbf959-8qrhg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-95fa4445-f8bcbf959-8qrhg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-95fa4445-f8bcbf959-8qrhg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-95fa4445-f8bcbf959-8qrhg

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.744s (5.744s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2b9202f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2b9202f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2b9202f4-85ccdf77f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2b9202f4-85ccdf77f7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2b9202f4-85ccdf77f7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2b9202f4-85ccdf77f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2b9202f4: serviceaccount "payload-processing-e2e-derive-2b9202f4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2b9202f4: serviceaccount "payload-processing-e2e-derive-2b9202f4" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-30d0c8aa-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-30d0c8aa-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-d6a47bf7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-24d78330-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-24d78330-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-d6a47bf7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-30d0c8aa-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-30d0c8aa-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6a47bf7-7dc674bd6c-4jj6h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d6a47bf7-7db7cc6c4f-jxxtg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-d6a47bf7-openshift-default-6bd8b956bc-5lwbr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-29ece5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-29ece5

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-24d78330-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-24d78330-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-95fa4445-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-24d78330-867bff44fc-xljll

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-24d78330-7d4499b8ff-6z4t9

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-95fa4445-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-migrate-30d0c8aa-dfc88b4b5-qfvz7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-30d0c8aa-7959895f-lrjn5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-29ece5-d7c776d9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-29ece5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-29ece5-d7c776d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-2b9202f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-29ece5: serviceaccount "payload-processing-e2e-worker-w2-29ece5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-29ece5-d7c776d9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-29ece5-d7c776d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-29ece5: serviceaccount "payload-processing-e2e-worker-w2-29ece5" not found
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-2b9202f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-29ece5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-29ece5-77b547645f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf

Created

Container created

openshift-ingress

kubelet

e2e-ait-24d78330-openshift-default-f7bc5cf4c-tq64z

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-ef2572

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-ef2572

openshift-ingress

kubelet

payload-processing-e2e-ait-95fa4445-f8bcbf959-8qrhg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-95fa4445-bc5886d59-xxhhn

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-2b9202f4-openshift-default-6c7dcff65-rgns6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-b63c24

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-b63c24

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

openshift-ingress

kubelet

payload-processing-e2e-derive-2b9202f4-85ccdf77f7-cm78l

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.39:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2b9202f4-5fcb468fc5-8g7c6

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.38:50052" within 1s: context deadline exceeded

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-30d0c8aa-gw-openshift-default-6b576f5fb5-rqjzv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-95fa4445-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-95fa4445-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-dd98f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-dd98f0

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-ef2572

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-ef2572-6ddf767845 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-ef2572

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-ef2572-6ddf767845

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-ef2572: serviceaccount "payload-processing-e2e-worker-w4-ef2572" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-ef2572-6ddf767845

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-ef2572-6ddf767845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-ef2572: serviceaccount "payload-processing-e2e-worker-w4-ef2572" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-b63c24

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-b63c24

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-b63c24-584548d76f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-b63c24-584548d76f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-b63c24-584548d76f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b63c24: serviceaccount "payload-processing-e2e-worker-w1-b63c24" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-b63c24-584548d76f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b63c24: serviceaccount "payload-processing-e2e-worker-w1-b63c24" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-dd98f0: serviceaccount "payload-processing-e2e-worker-w3-dd98f0" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-dd98f0: serviceaccount "payload-processing-e2e-worker-w3-dd98f0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-dd98f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-8bec73

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-8bec73

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-dd98f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4

openshift-ingress

kubelet

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc

Started

Container started

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-95fa4445-openshift-default-c9bd77677-wz7qd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-8bec73

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-8bec73

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-8bec73-74b4bf6479 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8bec73-74b4bf6479

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8bec73-74b4bf6479

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-8bec73-74b4bf6479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8bec73: serviceaccount "payload-processing-e2e-worker-w0-8bec73" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8bec73: serviceaccount "payload-processing-e2e-worker-w0-8bec73" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": read tcp 10.134.0.2:53794->10.134.0.54:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": read tcp 10.134.0.2:53794->10.134.0.54:15021: read: connection reset by peer
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 1 to 2

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 2 to 3

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-56f84cd566

SuccessfulCreate

Created pod: payload-processing-external-model-56f84cd566-gzxbm

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-56f84cd566 from 0 to 1
(x7)

models-as-a-service

replicaset-controller

payload-processing-external-model-56f84cd566

FailedCreate

Error creating: pods "payload-processing-external-model-56f84cd566-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-56f84cd566-gzxbm

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-56f84cd566-gzxbm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-56f84cd566-gzxbm

Started

Container started

models-as-a-service

multus

payload-processing-external-model-56f84cd566-gzxbm

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-kj5vp

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-hvt6d

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-z2grb

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-kj5vp

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-d4s6f

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-hvt6d

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-d4s6f

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-z2grb

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-58d4f57fc5 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-58d4f57fc5

SuccessfulCreate

Created pod: payload-processing-external-model-58d4f57fc5-wd9lt

models-as-a-service

kubelet

payload-processing-external-model-58d4f57fc5-wd9lt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-58d4f57fc5-wd9lt

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-58d4f57fc5-wd9lt

Created

Container created

models-as-a-service

multus

payload-processing-external-model-58d4f57fc5-wd9lt

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-6cc458d887-r7hr5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-sf86p

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-sf86p

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-r7hr5

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v

Created

Container created

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

Created

Container created

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v
(x5)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x3)

models-as-a-service

kubelet

payload-processing-external-model-56f84cd566-gzxbm

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-1a4f67076b57" not found
(x8)

models-as-a-service

kubelet

payload-processing-external-model-58d4f57fc5-wd9lt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

replicaset-controller

payload-processing-external-model-58d4f57fc5

SuccessfulDelete

Deleted pod: payload-processing-external-model-58d4f57fc5-wd9lt

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-w572x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5747777fbb-w572x

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-58d4f57fc5 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5747777fbb

SuccessfulCreate

Created pod: payload-processing-external-model-5747777fbb-w572x

models-as-a-service

kubelet

payload-processing-external-model-58d4f57fc5-wd9lt

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-w572x

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-w572x

Created

Container created
(x5)

models-as-a-service

kubelet

payload-processing-external-model-58d4f57fc5-wd9lt

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-bf4919d00529" not found

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 4 to 5

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 5 to 7

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

Started

Container started

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

Started

Container started

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x5)

models-as-a-service

kubelet

payload-processing-external-model-56f84cd566-gzxbm

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-bf4919d00529" not found

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

Created

Container created

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 3 to 4

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5747777fbb from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5747777fbb

SuccessfulDelete

Deleted pod: payload-processing-external-model-5747777fbb-w572x

models-as-a-service

kubelet

payload-processing-external-model-84cf56844-6pbmt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-84cf56844

SuccessfulCreate

Created pod: payload-processing-external-model-84cf56844-6pbmt

models-as-a-service

multus

payload-processing-external-model-84cf56844-6pbmt

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-w572x

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-84cf56844 from 0 to 1
(x9)

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-w572x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-84cf56844-6pbmt

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-84cf56844-6pbmt

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-56f84cd566

SuccessfulDelete

Deleted pod: payload-processing-external-model-56f84cd566-gzxbm

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-56f84cd566 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-56f84cd566-gzxbm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 7 to 9

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

Started

Container started

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 3 to 4

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

Created

Container created

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 4 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-6hbdx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5747777fbb from 0 to 1

models-as-a-service

multus

payload-processing-external-model-5747777fbb-6hbdx

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-6hbdx

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-6hbdx

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-5747777fbb

SuccessfulCreate

Created pod: payload-processing-external-model-5747777fbb-6hbdx

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 5 to 9

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

Started

Container started

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

Started

Container started

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x3)

models-as-a-service

kubelet

payload-processing-external-model-84cf56844-6pbmt

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-001239fd95f6" not found, secret "agc-cred-da8c34345bbb" not found]

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 4 to 7
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6
(x7)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

Created

Container created

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-6hbdx

Killing

Stopping container payload-processing
(x2)

models-as-a-service

kubelet

payload-processing-external-model-5747777fbb-6hbdx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-84cf56844-6pbmt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 6 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

Started

Container started
(x2)

models-as-a-service

kubelet

payload-processing-external-model-84cf56844-6pbmt

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-001239fd95f6" not found, secret "agc-cred-1a4f67076b57" not found, secret "agc-cred-da8c34345bbb" not found]

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

Created

Container created
(x9)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x11)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 9 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

openshift-ingress

multus

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

Unhealthy

Readiness probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

ProbeError

Readiness probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

Unhealthy

Readiness probe failed: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

Unhealthy

Readiness probe failed: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

ProbeError

Readiness probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

Unhealthy

Readiness probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

ProbeError

Readiness probe error: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

ProbeError

Readiness probe error: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x12)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes
(x13)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 7 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-mt-7e6fe88b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7e6fe88b

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

Started

Container started

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

Started

Container started

openshift-ingress

deployment-controller

e2e-mt-7e6fe88b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7e6fe88b-openshift-default-5b64b75c89 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

Unhealthy

Liveness probe failed: Get "https://10.132.0.50:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7e6fe88b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7e6fe88b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7e6fe88b-558b6b9b97 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7e6fe88b: serviceaccount "payload-processing-e2e-mt-7e6fe88b" not found
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7e6fe88b-558b6b9b97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7e6fe88b-558b6b9b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7e6fe88b: serviceaccount "payload-processing-e2e-mt-7e6fe88b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7e6fe88b-558b6b9b97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk
(x4)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk

Created

Container created
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 9 to 10

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

Unhealthy

Readiness probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-5ctsx
(x11)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-42ch2

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

ProbeError

Readiness probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b687k

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b687k

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-api-a-8c2357

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-8c2357

openshift-ingress

deployment-controller

e2e-api-a-8c2357-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-8c2357-openshift-default-659d454f6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-8c2357-openshift-default-659d454f6f

SuccessfulCreate

Created pod: e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 7.51s (7.51s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-8c2357

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-8c2357-655589dfb7 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8c2357-655589dfb7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-8c2357-655589dfb7-9txvh
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8c2357-bb9744f4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8c2357: serviceaccount "payload-processing-e2e-api-a-8c2357" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8c2357-bb9744f4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-jxkks

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-8c2357

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-8c2357-bb9744f4c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8c2357-655589dfb7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-8c2357-655589dfb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8c2357: serviceaccount "payload-processing-e2e-api-a-8c2357" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-8c2357-655589dfb7-9txvh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-jxkks

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-jxkks

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-8c2357-655589dfb7-9txvh

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-8c2357-655589dfb7-9txvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-8c2357-655589dfb7-9txvh

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-jxkks

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-jxkks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8c2357-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8c2357-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e6fe88b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e6fe88b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e6fe88b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e6fe88b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Unhealthy

Readiness probe failed: Get "http://10.132.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

ProbeError

Readiness probe error: Get "http://10.132.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-api-a-69a4bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-69a4bc-openshift-default-797b9d8659 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-3c636f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3c636f

openshift-ingress

gateway_labeler_controller

e2e-api-a-69a4bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-69a4bc

openshift-ingress

replicaset-controller

e2e-api-a-69a4bc-openshift-default-797b9d8659

SuccessfulCreate

Created pod: e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

openshift-ingress

deployment-controller

e2e-api-b-3c636f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3c636f-openshift-default-8685f58797 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-3c636f-openshift-default-8685f58797

SuccessfulCreate

Created pod: e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

openshift-ingress

multus

e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-69a4bc-69465f7c7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-69a4bc-69465f7c7-kvvq4

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-69a4bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-69a4bc-69465f7c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-69a4bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-5gwjd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-69a4bc: serviceaccount "payload-processing-e2e-api-a-69a4bc" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-69a4bc-69465f7c7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-69a4bc-69465f7c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-69a4bc: serviceaccount "payload-processing-e2e-api-a-69a4bc" not found

openshift-ingress

multus

payload-processing-e2e-api-a-69a4bc-69465f7c7-kvvq4

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-5gwjd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-5gwjd

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-5gwjd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-5gwjd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-69a4bc-69465f7c7-kvvq4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-69a4bc-69465f7c7-kvvq4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-69a4bc-69465f7c7-kvvq4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3c636f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3c636f-6948699f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3c636f-6948699f5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3c636f-6948699f5-hhkc2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3c636f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-bdr88
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3c636f: serviceaccount "payload-processing-e2e-api-b-3c636f" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3c636f-6948699f5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3c636f-6948699f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3c636f: serviceaccount "payload-processing-e2e-api-b-3c636f" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-bdr88

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-bdr88

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-3c636f-6948699f5-hhkc2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-3c636f-6948699f5-hhkc2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-bdr88

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-3c636f-6948699f5-hhkc2

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-bdr88

Started

Container started
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-b-3c636f-6948699f5-hhkc2

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8c2357-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8c2357-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-69a4bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-69a4bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused

opendatahub

multus

test-curl-7289-997b79

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7289-997b79

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7289-997b79

Created

Container created

opendatahub

kubelet

test-curl-7289-997b79

Started

Container started

opendatahub

kubelet

test-curl-7289-997b79

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.237s (3.237s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7289-997b79

Killing

Stopping container test-curl-7289-997b79
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3c636f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3c636f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-api-b-e942ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e942ab-openshift-default-9c697d45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-e942ab-openshift-default-9c697d45

SuccessfulCreate

Created pod: e2e-api-b-e942ab-openshift-default-9c697d45-s727f

openshift-ingress

gateway_labeler_controller

e2e-api-b-e942ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e942ab

openshift-ingress

multus

e2e-api-b-e942ab-openshift-default-9c697d45-s727f

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3c636f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3c636f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e942ab-7db488f9ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e942ab: serviceaccount "payload-processing-e2e-api-b-e942ab" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e942ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e942ab-7db488f9ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e942ab-7979b88bd7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e942ab-7979b88bd7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e942ab-7979b88bd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e942ab: serviceaccount "payload-processing-e2e-api-b-e942ab" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e942ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e942ab-7979b88bd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e942ab-7db488f9ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-qqfk7

openshift-ingress

kubelet

payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-qqfk7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-qqfk7

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-qqfk7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-qqfk7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-sqxmb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-292vk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-69a4bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-69a4bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8c2357-bb9744f4c-jxkks

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-8c2357-655589dfb7-9txvh

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-ac952a-openshift-default-7c54dc7589

SuccessfulCreate

Created pod: e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-ac952a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-ac952a

openshift-ingress

deployment-controller

e2e-ipp-a-ac952a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-ac952a-openshift-default-7c54dc7589 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ac952a: serviceaccount "payload-processing-e2e-ipp-a-ac952a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ac952a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ac952a-676dc686ff from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ac952a-676dc686ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ac952a-676dc686ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ac952a: serviceaccount "payload-processing-e2e-ipp-a-ac952a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ac952a-676dc686ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ac952a-676dc686ff-lzbkn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ac952a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-hdzd6

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-ac952a-676dc686ff-lzbkn

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-hdzd6

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-hdzd6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-676dc686ff-lzbkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-hdzd6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-676dc686ff-lzbkn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-676dc686ff-lzbkn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-hdzd6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-e942ab-openshift-default-9c697d45-s727f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-e942ab-openshift-default-9c697d45-s727f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-e942ab-openshift-default-9c697d45-s727f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-b-e942ab-openshift-default-9c697d45-s727f

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-e942ab-openshift-default-9c697d45-s727f

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7e6fe88b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7e6fe88b-558b6b9b97 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7e6fe88b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7e6fe88b-558b6b9b97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7e6fe88b-558b6b9b97-6zdb2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7e6fe88b-558b6b9b97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7e6fe88b-558b6b9b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7e6fe88b: serviceaccount "payload-processing-e2e-mt-7e6fe88b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7e6fe88b: serviceaccount "payload-processing-e2e-mt-7e6fe88b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-x5kqt

openshift-ingress

kubelet

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-8c2357-openshift-default-659d454f6f-chhkx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-6zdb2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-6zdb2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-6zdb2

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-x5kqt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-x5kqt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-6zdb2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-x5kqt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-x5kqt

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 10 to 4

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-t9js4

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-knm5g

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-6njss

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-lc4wb

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hfpv6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-4s7kn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f66180

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f66180

openshift-ingress

deployment-controller

e2e-ipp-a-f66180-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f66180-openshift-default-55cfc8577c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-f66180-openshift-default-55cfc8577c

SuccessfulCreate

Created pod: e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

openshift-ingress

multus

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e942ab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e942ab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-3c636f-6948699f5-hhkc2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3c636f-5fd8bf89c5-bdr88

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 10 to 4

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-g2cpd

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-ljdnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-522s8

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f66180-794b84955

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f66180-794b84955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f66180: serviceaccount "payload-processing-e2e-ipp-a-f66180" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f66180: serviceaccount "payload-processing-e2e-ipp-a-f66180" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f66180

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f66180-794b84955 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f66180

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f66180-794b84955

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f66180-794b84955-ndwz8

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-wqns9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-t5b4n

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f66180-794b84955-ndwz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-t5b4n

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-t5b4n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f66180-794b84955-ndwz8

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f66180-794b84955-ndwz8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-t5b4n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-t5b4n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f66180-794b84955-ndwz8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-k89gx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-2sg7k

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e942ab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e942ab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69a4bc-854d4ddb7-5gwjd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-69a4bc-69465f7c7-kvvq4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7n64p

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-fnnxh

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 8 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-cddng

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-qwx5j

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-gpwm9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-ckvvg

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-r8sjz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 10 to 5

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-8lrwv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-64pl5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7jc7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-676dc686ff-lzbkn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-66d6cb8df5-hdzd6

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57

SuccessfulCreate

Created pod: e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

openshift-ingress

deployment-controller

e2e-ipp-b-cb2b8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-cb2b8a-openshift-default-75dd976c57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-cb2b8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-cb2b8a

openshift-ingress

multus

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

Started

Container started

opendatahub

multus

test-curl-7289-da8265

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7289-da8265

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-cb2b8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-cb2b8a-7546789495 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-cb2b8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cb2b8a: serviceaccount "payload-processing-e2e-ipp-b-cb2b8a" not found

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e6fe88b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-7e6fe88b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7e6fe88b-openshift-default-5b64b75c89 from 1 to 4
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cb2b8a-7546789495

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-cb2b8a-7546789495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cb2b8a: serviceaccount "payload-processing-e2e-ipp-b-cb2b8a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-mn7lf

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-mn7lf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-mn7lf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-mn7lf

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-mn7lf

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cb2b8a-7546789495

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-cb2b8a-7546789495-5wzmh

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-cb2b8a-7546789495-5wzmh

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb2b8a-7546789495-5wzmh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb2b8a-7546789495-5wzmh

Created

Container created

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

Created

Container created

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

Started

Container started

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

Created

Container created

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb2b8a-7546789495-5wzmh

Started

Container started

opendatahub

kubelet

test-curl-7289-da8265

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 4.208s (4.208s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7289-da8265

Created

Container created

opendatahub

kubelet

test-curl-7289-da8265

Started

Container started

opendatahub

kubelet

test-curl-7289-da8265

Killing

Stopping container test-curl-7289-da8265
(x6)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ac952a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ac952a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e6fe88b-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-mt-7e6fe88b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7e6fe88b-openshift-default-5b64b75c89 from 4 to 8

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

Started

Container started

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

Started

Container started

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

Created

Container created

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

Started

Container started

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

Created

Container created

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

Created

Container created

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

Created

Container created

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-7e6fe88b-558b6b9b97-6zdb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-3c636f-openshift-default-8685f58797-ph54c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e6fe88b-6c89966b75-x5kqt

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f6979f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f6979f

openshift-ingress

kubelet

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ipp-b-f6979f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f6979f-openshift-default-569f6f8dff from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-f6979f-openshift-default-569f6f8dff

SuccessfulCreate

Created pod: e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

openshift-ingress

kubelet

e2e-api-a-69a4bc-openshift-default-797b9d8659-rgs5q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b647c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b647c3
(x5)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

Unhealthy

Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

ProbeError

Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

ProbeError

Startup probe error: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-a-b647c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b647c3-openshift-default-674fcc8445 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-b647c3-openshift-default-674fcc8445

SuccessfulCreate

Created pod: e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw
(x7)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

Unhealthy

Startup probe failed: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f66180-794b84955-ndwz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f66180-97cbb6f6c-t5b4n

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ac952a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ac952a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f66180-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f66180-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f6979f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f6979f-65c8bd494f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f6979f-65c8bd494f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f6979f-65c8bd494f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f6979f: serviceaccount "payload-processing-e2e-ipp-b-f6979f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f6979f-65c8bd494f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f6979f-65c8bd494f-hbt4m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f6979f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-n5nw5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f6979f: serviceaccount "payload-processing-e2e-ipp-b-f6979f" not found

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

openshift-ingress

deployment-controller

e2e-mt-7e6fe88b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7e6fe88b-openshift-default-5b64b75c89 from 8 to 10

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-n5nw5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-n5nw5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-n5nw5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6979f-65c8bd494f-hbt4m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6979f-65c8bd494f-hbt4m

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-n5nw5

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6979f-65c8bd494f-hbt4m

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-7e6fe88b-openshift-default-5b64b75c89

SuccessfulCreate

(combined from similar events): Created pod: e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7e6fe88b-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

Created

Container created

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-f6979f-65c8bd494f-hbt4m

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

Created

Container created

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e942ab-7db488f9ff-qqfk7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ac952a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b647c3: serviceaccount "payload-processing-e2e-ipp-a-b647c3" not found
(x6)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b647c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ac952a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ac952a-74bb985447 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b647c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b647c3-5b5b948867 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b647c3-5b5b948867

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b647c3-5b5b948867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b647c3: serviceaccount "payload-processing-e2e-ipp-a-b647c3" not found
(x6)

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-s999b

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b647c3-5b5b948867

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b647c3-5b5b948867-wzn9d
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ac952a: serviceaccount "payload-processing-e2e-ipp-a-ac952a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b647c3-5b5b948867-wzn9d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ac952a: serviceaccount "payload-processing-e2e-ipp-a-ac952a" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-b647c3-5b5b948867-wzn9d

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-s999b

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e942ab-7979b88bd7-s4r4v

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.93:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-s999b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-s999b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-s999b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b647c3-5b5b948867-wzn9d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b647c3-5b5b948867-wzn9d

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f66180-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f66180-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.126s (3.126s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.345s (2.345s including waiting). Image size: 166620835 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f66180

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f66180-85458794b8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f66180

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f66180-84487bc787 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f66180-84487bc787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f66180-84487bc787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f66180: serviceaccount "payload-processing-e2e-ipp-a-f66180" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f66180-85458794b8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f66180-85458794b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f66180: serviceaccount "payload-processing-e2e-ipp-a-f66180" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f66180-85458794b8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f66180-85458794b8-hw7f5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f66180-84487bc787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f66180-84487bc787-gjmlg

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f66180-84487bc787-gjmlg

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f66180-85458794b8-hw7f5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f66180-85458794b8-hw7f5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f66180-85458794b8-hw7f5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f66180-84487bc787-gjmlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f66180-85458794b8-hw7f5

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f66180-84487bc787-gjmlg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f66180-84487bc787-gjmlg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-ctmwm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-6jphm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-dj5n7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-8l2zb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-7rxlx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-eee7f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-eee7f1

openshift-ingress

deployment-controller

e2e-api-a-eee7f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-eee7f1-openshift-default-78d7b57c9 from 0 to 1

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-eee7f1-openshift-default-78d7b57c9

SuccessfulCreate

Created pod: e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-vtxl5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-l8cw5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-fhrss

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-q82cx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w8cqk

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7e6fe88b-openshift-default-5b64b75c89-qzgdm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-eee7f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-eee7f1-77669c5769 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-eee7f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-eee7f1-77669c5769

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-eee7f1-77669c5769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-eee7f1: serviceaccount "payload-processing-e2e-api-a-eee7f1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-kx6wj

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-eee7f1-77669c5769

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-eee7f1-77669c5769-fr9zj
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-eee7f1: serviceaccount "payload-processing-e2e-api-a-eee7f1" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-eee7f1-77669c5769-fr9zj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-eee7f1-77669c5769-fr9zj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-kx6wj

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-kx6wj

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-kx6wj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-eee7f1-77669c5769-fr9zj

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-eee7f1-77669c5769-fr9zj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-kx6wj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cb2b8a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cb2b8a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f6979f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f6979f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb2b8a-6c56c76d59-mn7lf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb2b8a-7546789495-5wzmh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f6979f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f6979f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-d4s6f

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-hvt6d

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-r7hr5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 10 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

Unhealthy

Readiness probe failed: Get "http://10.134.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r7hr5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

ProbeError

Readiness probe error: Get "http://10.134.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d4s6f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hvt6d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b647c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b647c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-e942ab-openshift-default-9c697d45-s727f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65

SuccessfulCreate

Created pod: e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

openshift-ingress

deployment-controller

e2e-praxis-a-8c08e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-8c08e7-openshift-default-5d56d76c65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-8c08e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-8c08e7

openshift-ingress

multus

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6979f-65c8bd494f-hbt4m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6979f-f774f5b55-n5nw5

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-eb41d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-eb41d3

openshift-ingress

replicaset-controller

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c

SuccessfulCreate

Created pod: e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

openshift-ingress

deployment-controller

e2e-ipp-b-eb41d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c from 0 to 1

openshift-ingress

multus

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8c08e7: serviceaccount "payload-processing-e2e-praxis-a-8c08e7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-8c08e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-8c08e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b647c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b647c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8c08e7: serviceaccount "payload-processing-e2e-praxis-a-8c08e7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b647c3-5b5b948867-wzn9d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b647c3-5d89c86dd7-s999b

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eb41d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eb41d3-5544bdb68f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-9zl2n
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eb41d3-5544bdb68f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eb41d3: serviceaccount "payload-processing-e2e-ipp-b-eb41d3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eb41d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eb41d3: serviceaccount "payload-processing-e2e-ipp-b-eb41d3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eb41d3-5544bdb68f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-nbc6x

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-9zl2n

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-nbc6x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-9zl2n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-9zl2n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-9zl2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-nbc6x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-nbc6x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-nbc6x

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-cb2b8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-cb2b8a-569f8b994d from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cb2b8a-569f8b994d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cb2b8a: serviceaccount "payload-processing-e2e-ipp-b-cb2b8a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-cb2b8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cb2b8a: serviceaccount "payload-processing-e2e-ipp-b-cb2b8a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-d52gg

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cb2b8a-569f8b994d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-4p5pf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-d52gg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-4p5pf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-d52gg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-d52gg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-d52gg

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-4p5pf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-4p5pf

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-4p5pf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f66180-84487bc787-gjmlg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f66180-85458794b8-hw7f5

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f6979f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f6979f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f6979f-78bd886898 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-hdx4x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f6979f-78bd886898

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f6979f-78bd886898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f6979f: serviceaccount "payload-processing-e2e-ipp-b-f6979f" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f6979f: serviceaccount "payload-processing-e2e-ipp-b-f6979f" not found

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-hl96f

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-gmkpn

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-gmkpn

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f6979f-78bd886898

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f6979f-78bd886898-gf67r

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-gmkpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-gmkpn

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-gmkpn

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-f6979f-78bd886898-gf67r

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6979f-78bd886898-gf67r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6979f-78bd886898-gf67r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6979f-78bd886898-gf67r

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

Unhealthy

Readiness probe failed: Get "http://10.134.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f66180-openshift-default-55cfc8577c-lfq7v

ProbeError

Readiness probe error: Get "http://10.134.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b647c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b647c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b647c3-799446d767 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b647c3: serviceaccount "payload-processing-e2e-ipp-a-b647c3" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b647c3-799446d767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b647c3-799446d767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b647c3: serviceaccount "payload-processing-e2e-ipp-a-b647c3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b647c3-799446d767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b647c3-799446d767-7g2mp

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b647c3-799446d767-7g2mp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b647c3-799446d767-7g2mp

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-srzhm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b647c3-799446d767-7g2mp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b647c3-799446d767-7g2mp

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-srzhm

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-srzhm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-srzhm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-srzhm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 4 to 3

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qc9cj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-dnbt9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-eee7f1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-eee7f1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-zp7t8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-31ae40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-31ae40

openshift-ingress

replicaset-controller

e2e-api-b-31ae40-openshift-default-66bb6b84bc

SuccessfulCreate

Created pod: e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

openshift-ingress

deployment-controller

e2e-api-b-31ae40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-31ae40-openshift-default-66bb6b84bc from 0 to 1

openshift-ingress

multus

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

Unhealthy

Readiness probe failed: Get "http://10.134.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

ProbeError

Readiness probe error: Get "http://10.134.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-31ae40: serviceaccount "payload-processing-e2e-api-b-31ae40" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-31ae40-9cd8c58b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-31ae40-9cd8c58b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-31ae40: serviceaccount "payload-processing-e2e-api-b-31ae40" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-31ae40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-rrbs6
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-31ae40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-31ae40-9cd8c58b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-31ae40-9cd8c58b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-31ae40-9cd8c58b9-6xlhm

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eb41d3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-31ae40-9cd8c58b9-6xlhm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-rrbs6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-31ae40-9cd8c58b9-6xlhm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-rrbs6

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-31ae40-9cd8c58b9-6xlhm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-rrbs6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-31ae40-9cd8c58b9-6xlhm

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-rrbs6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eb41d3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

ProbeError

Startup probe error: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

Unhealthy

Startup probe failed: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8c08e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8c08e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6979f-7754cc869f-gmkpn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6979f-78bd886898-gf67r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-f6979f-openshift-default-569f6f8dff-4k4gk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-7ea4b0-openshift-default-65c5776677

SuccessfulCreate

Created pod: e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-7ea4b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-7ea4b0

openshift-ingress

deployment-controller

e2e-praxis-a-7ea4b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-7ea4b0-openshift-default-65c5776677 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eb41d3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eb41d3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-7ea4b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-7ea4b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-7ea4b0: serviceaccount "payload-processing-e2e-praxis-a-7ea4b0" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-7ea4b0: serviceaccount "payload-processing-e2e-praxis-a-7ea4b0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-rlhnf

openshift-ingress

multus

payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-6cljj

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-rlhnf

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-6cljj

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-rlhnf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-rlhnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-6cljj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-6cljj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-9e4801

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-9e4801

openshift-ingress

replicaset-controller

e2e-praxis-b-9e4801-openshift-default-f96899fcc

SuccessfulCreate

Created pod: e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-rlhnf

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-b-9e4801-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9e4801-openshift-default-f96899fcc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-6cljj

Started

Container started

openshift-ingress

multus

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8c08e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8c08e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb41d3-5544bdb68f-nbc6x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb41d3-59c66658cf-9zl2n

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-9e4801

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-9e4801

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-9e4801-97fbd5b87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-r2x25
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9e4801-97fbd5b87

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-9e4801-97fbd5b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9e4801: serviceaccount "payload-processing-e2e-praxis-b-9e4801" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9e4801: serviceaccount "payload-processing-e2e-praxis-b-9e4801" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-r2x25

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9e4801-97fbd5b87

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-9e4801-97fbd5b87-h2lzf

openshift-ingress

multus

payload-processing-e2e-praxis-b-9e4801-97fbd5b87-h2lzf

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-r2x25

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-r2x25

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9e4801-97fbd5b87-h2lzf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9e4801-97fbd5b87-h2lzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9e4801-97fbd5b87-h2lzf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-r2x25

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b647c3-5b7c7c4c44-srzhm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b647c3-799446d767-7g2mp

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-sf86p

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sf86p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

Unhealthy

Readiness probe failed: Get "http://10.134.0.128:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

ProbeError

Readiness probe error: Get "http://10.134.0.128:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-b647c3-openshift-default-674fcc8445-tvzlw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ac952a-5b9c6cc7cb-2jbmb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ac952a-74bb985447-kbvfk

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-z2grb

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-4f8rv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-ckw6b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-7f5m9

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-z2grb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-31ae40-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-31ae40-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eb41d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eb41d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eb41d3-764494467f from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eb41d3-764494467f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eb41d3: serviceaccount "payload-processing-e2e-ipp-b-eb41d3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eb41d3-764494467f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-4rfrk
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eb41d3: serviceaccount "payload-processing-e2e-ipp-b-eb41d3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-4rfrk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-4rfrk

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-tcknv

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-4rfrk

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-4rfrk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-tcknv

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-tcknv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-tcknv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-tcknv

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-kj5vp

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-p9kw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kj5vp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-31ae40-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-31ae40-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

Unhealthy

Startup probe failed: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

ProbeError

Startup probe error: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ea4b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ea4b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-ac952a-openshift-default-7c54dc7589-gpplm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-eee7f1-b9f89c67f-kx6wj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-eee7f1-77669c5769-fr9zj

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9e4801-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9e4801-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ea4b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ea4b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb41d3-cbcb48f6b-tcknv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb41d3-764494467f-4rfrk

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-4ab4aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-4ab4aa

openshift-ingress

deployment-controller

e2e-praxis-b-4ab4aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-4ab4aa-openshift-default-799d6fd5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5

SuccessfulCreate

Created pod: e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

openshift-ingress

multus

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-eb41d3-openshift-default-5bdbd7758c-lqfzl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9e4801-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9e4801-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb2b8a-569f8b994d-4p5pf

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-add5bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-add5bf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb2b8a-bb5bcdff5-d52gg

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-praxis-a-add5bf-openshift-default-cc4d5db49

SuccessfulCreate

Created pod: e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

openshift-ingress

deployment-controller

e2e-praxis-a-add5bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-add5bf-openshift-default-cc4d5db49 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-kdx2l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-4ab4aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-4ab4aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-n4vgd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4ab4aa: serviceaccount "payload-processing-e2e-praxis-b-4ab4aa" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4ab4aa: serviceaccount "payload-processing-e2e-praxis-b-4ab4aa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-kdx2l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-kdx2l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-n4vgd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-n4vgd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-n4vgd

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-kdx2l

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-kdx2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-n4vgd

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-add5bf-564b7f99c5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-add5bf-564b7f99c5-dhn9p

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-add5bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-add5bf-564b7f99c5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-add5bf-564b7f99c5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-add5bf-564b7f99c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-add5bf: serviceaccount "payload-processing-e2e-praxis-a-add5bf" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-add5bf-898b54d47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-add5bf: serviceaccount "payload-processing-e2e-praxis-a-add5bf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-add5bf-898b54d47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-blfp7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-add5bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-add5bf-898b54d47 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-add5bf-564b7f99c5-dhn9p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-blfp7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-blfp7

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-blfp7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-blfp7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-add5bf-564b7f99c5-dhn9p

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-cb2b8a-openshift-default-75dd976c57-4jgr7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-add5bf-564b7f99c5-dhn9p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-add5bf-564b7f99c5-dhn9p

Created

Container created

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-5ctsx

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5ctsx

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-vqsxn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-f75sz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-eee7f1-openshift-default-78d7b57c9-cn4g6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-31ae40-9cd8c58b9-6xlhm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-31ae40-bc6fdccdc-rrbs6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

Unhealthy

Startup probe failed: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

ProbeError

Startup probe error: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4ab4aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4ab4aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

Unhealthy

Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

ProbeError

Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-add5bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-add5bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 4 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4ab4aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4ab4aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-praxis-b-3f25cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-3f25cd-openshift-default-576b49df5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-3f25cd-openshift-default-576b49df5c

SuccessfulCreate

Created pod: e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-3f25cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-3f25cd
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-add5bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-add5bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ea4b0-75f8f8786f-6cljj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ea4b0-68cb74f9-rlhnf

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-3f25cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-3f25cd-59987c57ff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-3f25cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3f25cd: serviceaccount "payload-processing-e2e-praxis-b-3f25cd" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-xbpcl

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3f25cd-59987c57ff

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-3f25cd-59987c57ff-949wh
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3f25cd-59987c57ff

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-3f25cd-59987c57ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3f25cd: serviceaccount "payload-processing-e2e-praxis-b-3f25cd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-xbpcl

openshift-ingress

multus

payload-processing-e2e-praxis-b-3f25cd-59987c57ff-949wh

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3f25cd-59987c57ff-949wh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-xbpcl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-xbpcl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-xbpcl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3f25cd-59987c57ff-949wh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3f25cd-59987c57ff-949wh

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-7ea4b0-openshift-default-65c5776677-nw4cq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 5 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4ab4aa-69d999c6c5-kdx2l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4ab4aa-5d9969dd59-n4vgd

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

ProbeError

Startup probe error: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

ProbeError

Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

Unhealthy

Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

Unhealthy

Startup probe failed: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c08e7-5668d6bd7c-btcgk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c08e7-699cfc9bd7-gglmr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-dd98f0-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-dd98f0-openshift-default-55954fcc8f from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-dd98f0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-b687k

openshift-ingress

replicaset-controller

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-pqv5l

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 4 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-qvtmw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-pqv5l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b687k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-54tvd

openshift-ingress

kubelet

e2e-api-b-31ae40-openshift-default-66bb6b84bc-8wrm6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-f1d081-openshift-default-56c48f6487

SuccessfulCreate

Created pod: e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

openshift-ingress

deployment-controller

e2e-ipp-a-f1d081-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f1d081-openshift-default-56c48f6487 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f1d081

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f1d081

openshift-ingress

multus

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f1d081: serviceaccount "payload-processing-e2e-ipp-a-f1d081" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-xm4lr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f1d081

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f1d081-7866949869 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f1d081-7866949869

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f1d081-7866949869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f1d081: serviceaccount "payload-processing-e2e-ipp-a-f1d081" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f1d081

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-xm4lr

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1d081-7866949869-8hd89

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1d081-7866949869-8hd89

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-xm4lr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-xm4lr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f1d081-7866949869

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f1d081-7866949869-8hd89

openshift-ingress

multus

payload-processing-e2e-ipp-a-f1d081-7866949869-8hd89

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 9 to 10

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1d081-7866949869-8hd89

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulCreate

Created pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-xm4lr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-b-3f25cd-openshift-default-576b49df5c

SuccessfulCreate

Created pod: e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

openshift-ingress

multus

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3f25cd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-b-3f25cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-3f25cd-openshift-default-576b49df5c from 1 to 2

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3f25cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3f25cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-4ab4aa-openshift-default-799d6fd5-pqg68

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3f25cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3f25cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-add5bf-898b54d47-blfp7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-add5bf-564b7f99c5-dhn9p

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

Unhealthy

Readiness probe failed: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

ProbeError

Readiness probe error: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

Unhealthy

Startup probe failed: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

ProbeError

Startup probe error: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-add5bf-openshift-default-cc4d5db49-gr8ph

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f1d081-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3f25cd-59987c57ff-949wh

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f1d081-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3f25cd-65b4c85fff-xbpcl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1d081-7866949869-8hd89

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1d081-7b4d567df9-xm4lr

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f1d081-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f1d081-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-8fb7f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-8fb7f0

openshift-ingress

replicaset-controller

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69

SuccessfulCreate

Created pod: e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

openshift-ingress

kubelet

e2e-praxis-a-8c08e7-openshift-default-5d56d76c65-qnh6x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-8fb7f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes
(x3)

openshift-ingress

deployment-controller

e2e-worker-w0-8bec73-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-7b9dp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8bec73-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc

SuccessfulDelete

Deleted pod: e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f
(x3)

openshift-ingress

deployment-controller

e2e-worker-w2-29ece5-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-29ece5-openshift-default-6fcb86dbc from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-29ece5-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-6j72f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-8fb7f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-8fb7f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-8fb7f0: serviceaccount "payload-processing-e2e-shared-a-w4-8fb7f0" not found

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

Created

Container created

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-8fb7f0: serviceaccount "payload-processing-e2e-shared-a-w4-8fb7f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

ProbeError

Startup probe error: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

Unhealthy

Startup probe failed: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-ba34eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-ba34eb

openshift-ingress

deployment-controller

e2e-shared-a-w1-ba34eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5

SuccessfulCreate

Created pod: e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9e4801-748ccff66c-r2x25

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9e4801-97fbd5b87-h2lzf

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f1d081

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f1d081-8bc8c89c8 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f1d081-8bc8c89c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f1d081: serviceaccount "payload-processing-e2e-ipp-a-f1d081" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f1d081

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f1d081: serviceaccount "payload-processing-e2e-ipp-a-f1d081" not found

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-ba34eb: serviceaccount "payload-processing-e2e-shared-a-w1-ba34eb" not found

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-ba34eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-ba34eb: serviceaccount "payload-processing-e2e-shared-a-w1-ba34eb" not found

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-ba34eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-46qzr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-46qzr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-46qzr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-j7s55

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-46qzr

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-46qzr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f1d081-8bc8c89c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-j7s55

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-j7s55

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-j7s55

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-j7s55

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-fnh7c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-3f25cd-openshift-default-576b49df5c-j48jb

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-4397fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-4397fc

openshift-ingress

replicaset-controller

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f

SuccessfulCreate

Created pod: e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

openshift-ingress

deployment-controller

e2e-shared-a-w2-4397fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-4397fc-openshift-default-6b458f575f from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-66e263

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-66e263

openshift-ingress

replicaset-controller

e2e-ipp-b-66e263-openshift-default-589754cbf

SuccessfulCreate

Created pod: e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

openshift-ingress

deployment-controller

e2e-ipp-b-66e263-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-66e263-openshift-default-589754cbf from 0 to 1

openshift-ingress

multus

e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4397fc: serviceaccount "payload-processing-e2e-shared-a-w2-4397fc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-4397fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-4397fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4397fc: serviceaccount "payload-processing-e2e-shared-a-w2-4397fc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-g6gxl

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-66e263-f78d47599

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-66e263-f78d47599-bvgvd

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-66e263

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-66e263-f78d47599 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-66e263

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-66e263-f78d47599

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-66e263-f78d47599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-66e263: serviceaccount "payload-processing-e2e-ipp-b-66e263" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-66e263: serviceaccount "payload-processing-e2e-ipp-b-66e263" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-66e263-f78d47599-bvgvd

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-f78d47599-bvgvd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-f78d47599-bvgvd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-g6gxl

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-g6gxl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-f78d47599-bvgvd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-g6gxl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-g6gxl

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-9e4801-openshift-default-f96899fcc-4z4bp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-66e263-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-66e263-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9

SuccessfulCreate

Created pod: e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-cb9a07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-cb9a07

openshift-ingress

deployment-controller

e2e-shared-a-w0-cb9a07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulCreate

Created pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-cb9a07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-cb9a07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-cb9a07: serviceaccount "payload-processing-e2e-shared-a-w0-cb9a07" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-cb9a07: serviceaccount "payload-processing-e2e-shared-a-w0-cb9a07" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

Unhealthy

Startup probe failed: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

ProbeError

Startup probe error: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8fb7f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8fb7f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-a72754

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-a72754

openshift-ingress

multus

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w4-a72754-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5

SuccessfulCreate

Created pod: e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-a72754

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-a72754-747f45dbc5 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8fb7f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8fb7f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-a72754

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-a72754: serviceaccount "payload-processing-e2e-shared-b-w4-a72754" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-a72754: serviceaccount "payload-processing-e2e-shared-b-w4-a72754" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

ProbeError

Startup probe error: Get "http://10.134.0.158:15021/healthz/ready": dial tcp 10.134.0.158:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

Unhealthy

Startup probe failed: Get "http://10.134.0.158:15021/healthz/ready": dial tcp 10.134.0.158:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-ba34eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-ba34eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-3be6fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-3be6fa

openshift-ingress

replicaset-controller

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477

SuccessfulCreate

Created pod: e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

openshift-ingress

deployment-controller

e2e-shared-b-w1-3be6fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4397fc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4397fc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-66e263-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-66e263-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-3be6fa: serviceaccount "payload-processing-e2e-shared-b-w1-3be6fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-3be6fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-3be6fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-3be6fa: serviceaccount "payload-processing-e2e-shared-b-w1-3be6fa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4397fc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4397fc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

Unhealthy

Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

ProbeError

Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f9925a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f9925a

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c

SuccessfulCreate

Created pod: e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

openshift-ingress

deployment-controller

e2e-shared-b-w2-f9925a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f9925a: serviceaccount "payload-processing-e2e-shared-b-w2-f9925a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f9925a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f9925a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f9925a: serviceaccount "payload-processing-e2e-shared-b-w2-f9925a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-cb9a07-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-cb9a07-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-3be6fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-3be6fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-f78d47599-bvgvd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-66e263-56774d5b9f-g6gxl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-cb9a07-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-cb9a07-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w0-7f8596-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c

SuccessfulCreate

Created pod: e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-7f8596

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-7f8596

openshift-ingress

multus

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-7f8596

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-7f8596

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-7f8596: serviceaccount "payload-processing-e2e-shared-b-w0-7f8596" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-7f8596: serviceaccount "payload-processing-e2e-shared-b-w0-7f8596" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-a72754-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-a72754-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-66e263

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-66e263-6c475c94c6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-66e263

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-66e263: serviceaccount "payload-processing-e2e-ipp-b-66e263" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-66e263-6c475c94c6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-66e263-6c475c94c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-66e263: serviceaccount "payload-processing-e2e-ipp-b-66e263" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-cb5r2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-cb5r2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-cb5r2

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-66e263-6c475c94c6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-cb5r2

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-cb5r2

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-a72754-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-a72754-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

ProbeError

Readiness probe error: Get "http://10.134.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

Unhealthy

Readiness probe failed: Get "http://10.134.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

Unhealthy

Startup probe failed: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

ProbeError

Startup probe error: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-f9925a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-f9925a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

Unhealthy

Readiness probe failed: Get "http://10.132.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

ProbeError

Readiness probe error: Get "http://10.132.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

ProbeError

Readiness probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

Unhealthy

Readiness probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

Unhealthy

Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

ProbeError

Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 10 to 6

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-gqrql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-w2wwr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-kj2xs

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-j8sv9

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1d081-8bc8c89c8-j7s55

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1d081-5c766b5c87-46qzr

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-rr5k6

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-zcnsn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-wfrh9

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-3be6fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-3be6fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rr5k6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f1d081-openshift-default-56c48f6487-9v42v

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-7f8596-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-7f8596-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-dt5qk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-4jv2z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

Unhealthy

Readiness probe failed: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-7c849

ProbeError

Readiness probe error: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-66e263-55994d8d9f-cb5r2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-66e263-6c475c94c6-ffdw2

Unhealthy

Readiness probe failed: dial tcp 10.132.0.157:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-66e263-openshift-default-589754cbf-p52j2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-8ddd2c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-8ddd2c

openshift-ingress

deployment-controller

e2e-explicit-8ddd2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-8ddd2c-openshift-default-855cd88c9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-8ddd2c-openshift-default-855cd88c9c

SuccessfulCreate

Created pod: e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

openshift-ingress

multus

e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8ddd2c: serviceaccount "payload-processing-e2e-explicit-8ddd2c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-8ddd2c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-8ddd2c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-8ddd2c-6ffc4db587 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8ddd2c-6ffc4db587

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-8ddd2c-6ffc4db587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8ddd2c: serviceaccount "payload-processing-e2e-explicit-8ddd2c" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-pfjc2

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8ddd2c-6ffc4db587

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-8ddd2c-6ffc4db587-f2g6h

openshift-ingress

multus

payload-processing-e2e-explicit-8ddd2c-6ffc4db587-f2g6h

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-pfjc2

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-pfjc2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-8ddd2c-6ffc4db587-f2g6h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-pfjc2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-8ddd2c-6ffc4db587-f2g6h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-8ddd2c-6ffc4db587-f2g6h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-pfjc2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-n7xft
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 4 to 3
(x2)

openshift-ingress

kubelet

e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 3 to 2
(x2)

openshift-ingress

kubelet

e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-8ddd2c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-8ddd2c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-jzzgt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-8ddd2c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-8ddd2c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-snk9h

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

e2e-worker-w4-ef2572-openshift-default-7649dd87

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-ef2572-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target
(x8)

openshift-ingress

deployment-controller

e2e-worker-w4-ef2572-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-ef2572-openshift-default-7649dd87 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-6mskn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8ddd2c-69b95b5867-pfjc2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8ddd2c-6ffc4db587-f2g6h

Killing

Stopping container payload-processing

opendatahub

kubelet

test-curl-7292-0d3744

Started

Container started

opendatahub

multus

test-curl-7292-0d3744

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7292-0d3744

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7292-0d3744

Created

Container created

opendatahub

kubelet

test-curl-7292-a9d7ca

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7292-0d3744

Killing

Stopping container test-curl-7292-0d3744

opendatahub

multus

test-curl-7292-a9d7ca

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7292-a9d7ca

Created

Container created

opendatahub

kubelet

test-curl-7292-a9d7ca

Started

Container started

opendatahub

kubelet

test-curl-7292-a9d7ca

Killing

Stopping container test-curl-7292-a9d7ca

opendatahub

kubelet

test-curl-7292-e8494e

Started

Container started

opendatahub

multus

test-curl-7292-e8494e

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7292-e8494e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7292-e8494e

Created

Container created

opendatahub

kubelet

test-curl-7292-382c01

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7292-382c01

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7292-e8494e

Killing

Stopping container test-curl-7292-e8494e

opendatahub

kubelet

test-curl-7292-382c01

Created

Container created

opendatahub

kubelet

test-curl-7292-382c01

Started

Container started

opendatahub

kubelet

test-curl-7292-382c01

Killing

Stopping container test-curl-7292-382c01

opendatahub

multus

test-curl-7292-123d75

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7292-123d75

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7292-123d75

Created

Container created

opendatahub

kubelet

test-curl-7292-123d75

Started

Container started

opendatahub

kubelet

test-curl-7292-123d75

Killing

Stopping container test-curl-7292-123d75

opendatahub

multus

test-curl-7292-ff3a7e

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7292-ff3a7e

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7292-ff3a7e

Started

Container started

opendatahub

kubelet

test-curl-7292-ff3a7e

Created

Container created

opendatahub

kubelet

test-curl-7292-ff3a7e

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.478s (1.478s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7292-ff3a7e

Killing

Stopping container test-curl-7292-ff3a7e

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-eb68dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-eb68dd

openshift-ingress

replicaset-controller

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc

SuccessfulCreate

Created pod: e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

openshift-ingress

deployment-controller

e2e-extmod-a-eb68dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-eb68dd-openshift-default-98b48c6cc from 0 to 1

openshift-ingress

multus

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-8ddd2c-openshift-default-855cd88c9c-kk6zt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-eb68dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-eb68dd-79b7d8c769 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-eb68dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-eb68dd-79b7d8c769

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-eb68dd: serviceaccount "payload-processing-e2e-extmod-a-eb68dd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-jrt8z
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-eb68dd: serviceaccount "payload-processing-e2e-extmod-a-eb68dd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-eb68dd-79b7d8c769

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-xr7cl

openshift-ingress

replicaset-controller

e2e-noten-c32349-openshift-default-848479bc65

SuccessfulCreate

Created pod: e2e-noten-c32349-openshift-default-848479bc65-mghjd

openshift-ingress

deployment-controller

e2e-noten-c32349-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-c32349-openshift-default-848479bc65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-c32349

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-c32349

openshift-ingress

multus

payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-xr7cl

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-jrt8z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-xr7cl

Started

Container started

openshift-ingress

kubelet

e2e-noten-c32349-openshift-default-848479bc65-mghjd

Created

Container created

openshift-ingress

kubelet

e2e-noten-c32349-openshift-default-848479bc65-mghjd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-jrt8z

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-jrt8z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-c32349-openshift-default-848479bc65-mghjd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-jrt8z

Started

Container started

openshift-ingress

multus

e2e-noten-c32349-openshift-default-848479bc65-mghjd

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-xr7cl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-xr7cl

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-c32349-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-c32349-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb68dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb68dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-c32349-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-c32349-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

test-curl-7280-5cdc18

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7280-5cdc18

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7280-5cdc18

Created

Container created

opendatahub

kubelet

test-curl-7280-5cdc18

Started

Container started

opendatahub

kubelet

test-curl-7280-5cdc18

Killing

Stopping container test-curl-7280-5cdc18

openshift-ingress

kubelet

e2e-noten-c32349-openshift-default-848479bc65-mghjd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-c32349-openshift-default-848479bc65-mghjd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-c32349-openshift-default-848479bc65-mghjd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569

SuccessfulCreate

Created pod: e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-3aca3f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-3aca3f

openshift-ingress

deployment-controller

e2e-extmod-a-3aca3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-3aca3f-openshift-default-5b88c4d569 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-hwmd2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-3aca3f-554dd84857

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-3aca3f-554dd84857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-3aca3f: serviceaccount "payload-processing-e2e-extmod-a-3aca3f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-3aca3f-554dd84857

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-3aca3f-554dd84857-59rv6

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-3aca3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-3aca3f-554dd84857 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-3aca3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-3aca3f: serviceaccount "payload-processing-e2e-extmod-a-3aca3f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-hwmd2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-hwmd2

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-hwmd2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-3aca3f-554dd84857-59rv6

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3aca3f-554dd84857-59rv6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3aca3f-554dd84857-59rv6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-hwmd2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3aca3f-554dd84857-59rv6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

ProbeError

Readiness probe error: Get "http://10.134.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

Unhealthy

Readiness probe failed: Get "http://10.134.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

ProbeError

Startup probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

Unhealthy

Startup probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d067bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d067bd

openshift-ingress

deployment-controller

e2e-extmod-a-d067bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d067bd-openshift-default-766dbd44fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-d067bd-openshift-default-766dbd44fc

SuccessfulCreate

Created pod: e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

openshift-ingress

multus

e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-6b5091

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-6b5091

openshift-ingress

deployment-controller

e2e-autores-6b5091-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-6b5091-openshift-default-776b46b7bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-6b5091-openshift-default-776b46b7bf

SuccessfulCreate

Created pod: e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

openshift-ingress

multus

e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d067bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d067bd-5f586dc769 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-22k9f

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d067bd-5f586dc769

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d067bd-5f586dc769-w9w7j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d067bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d067bd: serviceaccount "payload-processing-e2e-extmod-a-d067bd" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d067bd-5f586dc769

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d067bd-5f586dc769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d067bd: serviceaccount "payload-processing-e2e-extmod-a-d067bd" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-22k9f

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-22k9f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d067bd-5f586dc769-w9w7j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d067bd-5f586dc769-w9w7j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d067bd-5f586dc769-w9w7j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-d067bd-5f586dc769-w9w7j

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-22k9f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-22k9f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-b63c24-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b63c24-openshift-default-d8c64855f from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b63c24-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-6b5091

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-6b5091-755985cf47 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b63c24-openshift-default-d8c64855f

SuccessfulDelete

Deleted pod: e2e-worker-w1-b63c24-openshift-default-d8c64855f-vx98r

openshift-ingress

deployment-controller

payload-processing-e2e-autores-6b5091

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-6b5091-557fb7f58c from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d067bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d067bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-6b5091-557fb7f58c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-6b5091-557fb7f58c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-6b5091: serviceaccount "payload-processing-e2e-autores-6b5091" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-6b5091-755985cf47-tf5vq

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-6b5091-755985cf47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-6b5091-755985cf47-tf5vq

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6b5091-755985cf47-tf5vq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-6b5091-557fb7f58c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-6b5091-557fb7f58c-l8l7k
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-6b5091-755985cf47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-6b5091-755985cf47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-6b5091: serviceaccount "payload-processing-e2e-autores-6b5091" not found

openshift-ingress

multus

payload-processing-e2e-autores-6b5091-557fb7f58c-l8l7k

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-6b5091-557fb7f58c-l8l7k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-6b5091-557fb7f58c-l8l7k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-6b5091-557fb7f58c-l8l7k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6b5091-755985cf47-tf5vq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6b5091-755985cf47-tf5vq

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-08fcc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-08fcc4

openshift-ingress

replicaset-controller

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f

SuccessfulCreate

Created pod: e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

openshift-ingress

multus

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-08fcc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-08fcc4-openshift-default-7985d77b8f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb68dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-eb68dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-9332a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-9332a5

openshift-ingress

deployment-controller

e2e-extmod-b-9332a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-9332a5-openshift-default-6556fcb9df from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-9332a5-openshift-default-6556fcb9df

SuccessfulCreate

Created pod: e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

openshift-ingress

multus

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-08fcc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-08fcc4-7fc46bc755 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-08fcc4-7fc46bc755

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-08fcc4: serviceaccount "payload-processing-e2e-extmod-a-08fcc4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-08fcc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-08fcc4: serviceaccount "payload-processing-e2e-extmod-a-08fcc4" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-qcr2l

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-qcr2l

AddedInterface

Add eth0 [10.133.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-lkxlp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-lkxlp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-lkxlp

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-08fcc4-7fc46bc755

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-qcr2l

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-qcr2l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-qcr2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-lkxlp

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-lkxlp

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-9332a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-9332a5-b66fd5659 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9332a5-b66fd5659

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-9332a5-b66fd5659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9332a5: serviceaccount "payload-processing-e2e-extmod-b-9332a5" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9332a5: serviceaccount "payload-processing-e2e-extmod-b-9332a5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-9332a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-l4x5f

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-l4x5f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-l4x5f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-l4x5f

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-l4x5f

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9332a5-b66fd5659

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-9332a5-b66fd5659-2ddd4

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9332a5-b66fd5659-2ddd4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9332a5-b66fd5659-2ddd4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9332a5-b66fd5659-2ddd4

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-9332a5-b66fd5659-2ddd4

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9332a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9332a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

ProbeError

Startup probe error: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

Unhealthy

Startup probe failed: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3aca3f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3aca3f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3aca3f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3aca3f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6b5091-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6b5091-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

Unhealthy

Readiness probe failed: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

ProbeError

Readiness probe error: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d067bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d067bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6b5091-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6b5091-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-08fcc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-08fcc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3aca3f-67994c4bc5-hwmd2

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3aca3f-554dd84857-59rv6

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9332a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9332a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-autores-6b5091-557fb7f58c-l8l7k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6b5091-755985cf47-tf5vq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d067bd-5f586dc769-w9w7j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d067bd-7469974c5f-22k9f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-08fcc4-7fc46bc755-qcr2l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-08fcc4-7698dffc5-lkxlp

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-08fcc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-08fcc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-eb68dd-79b7d8c769-xr7cl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-eb68dd-6d6bfd955f-jrt8z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-3aca3f-openshift-default-5b88c4d569-chckm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ba34eb-6ddd8d9c5c-jw2x7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ba34eb-df7485b87-rc2mv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-d067bd-openshift-default-766dbd44fc-7zjcd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-6b5091-openshift-default-776b46b7bf-sw4qr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-c61da9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-c61da9

openshift-ingress

replicaset-controller

e2e-extmod-a-c61da9-openshift-default-76f5864d45

SuccessfulCreate

Created pod: e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

openshift-ingress

deployment-controller

e2e-extmod-a-c61da9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c61da9-openshift-default-76f5864d45 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-96cr9

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-c61da9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-c61da9-78dcc86799 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-c61da9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c61da9-78dcc86799

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-c61da9-78dcc86799-qspwl
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c61da9-78dcc86799

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-c61da9-78dcc86799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c61da9: serviceaccount "payload-processing-e2e-extmod-a-c61da9" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c61da9: serviceaccount "payload-processing-e2e-extmod-a-c61da9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-96cr9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c61da9-78dcc86799-qspwl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-96cr9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-96cr9

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c61da9-78dcc86799-qspwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-c61da9-78dcc86799-qspwl

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-96cr9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c61da9-78dcc86799-qspwl

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-08fcc4-openshift-default-7985d77b8f-t22ds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-eb68dd-openshift-default-98b48c6cc-gfz48

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9332a5-5b55b4bff9-l4x5f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9332a5-b66fd5659-2ddd4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-dd98f0-9b775c64c-4f9xc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-dd98f0-7cf4455d8c-979g4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4397fc-6bd899b57f-ghm7d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4397fc-86dfb8f9c-g8gwd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-ba34eb-openshift-default-98cfdc4c5-f7gpd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-4397fc-openshift-default-6b458f575f-tvgdj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3be6fa-c4f89678c-9xl9s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3be6fa-64ccb8dc67-p2zgf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-9332a5-openshift-default-6556fcb9df-f2hqd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9925a-d9db6c895-hzj5k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9925a-bd8fbb5dc-brvjt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8fb7f0-5889f6f4ff-r76rq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8fb7f0-796d4996ff-25jt7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-3be6fa-openshift-default-7b46d4f477-plkgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-6bd7c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-6bd7c8-openshift-default-5b6745476f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-6bd7c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-6bd7c8

openshift-ingress

kubelet

e2e-shared-b-w2-f9925a-openshift-default-6d99c6d9c-nfzmj

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f

SuccessfulCreate

Created pod: e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

openshift-ingress

deployment-controller

e2e-extmod-a-c61da9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c61da9-openshift-default-76f5864d45 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-a-c61da9-openshift-default-76f5864d45

SuccessfulCreate

Created pod: e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c61da9-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

Started

Container started

openshift-ingress

multus

e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

Unhealthy

Readiness probe failed: Get "http://10.132.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-dd98f0-openshift-default-55954fcc8f-bmpwp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

ProbeError

Readiness probe error: Get "http://10.132.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-8fb7f0-openshift-default-77b6794b69-bqwdf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-6bd7c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6bd7c8: serviceaccount "payload-processing-e2e-extmod-b-6bd7c8" not found
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-7wb2p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-6bd7c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-mn6j9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6bd7c8: serviceaccount "payload-processing-e2e-extmod-b-6bd7c8" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-mn6j9

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-7wb2p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-7wb2p

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-7wb2p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-mn6j9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-mn6j9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-mn6j9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-7wb2p

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

Unhealthy

Startup probe failed: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

ProbeError

Startup probe error: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b63c24-75cd4d9679-cpvtw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b63c24-584548d76f-mcbrl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6bd7c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6bd7c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c61da9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c61da9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-29ece5-d7c776d9-4jlcf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-29ece5-77b547645f-td54f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-a72754-747f45dbc5-sl782

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-a72754-6f55ccb6f5-b2n7l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-a72754-openshift-default-6dbf8c96d5-c4xcb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-29ece5-openshift-default-6fcb86dbc-n2k5v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b63c24-openshift-default-d8c64855f-6mgf7

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

ProbeError

Startup probe error: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

Unhealthy

Startup probe failed: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ef2572-66ff5d84b7-q78cc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ef2572-6ddf767845-8mv7r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6bd7c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6bd7c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-ef2572-openshift-default-7649dd87-d9zt7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c61da9-6f87f9496c-96cr9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c61da9-78dcc86799-qspwl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-n9kll

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-c61da9-openshift-default-76f5864d45-7gh6h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6bd7c8-58894cfb4c-7wb2p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6bd7c8-7c8f784fd9-mn6j9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-6bd7c8-openshift-default-5b6745476f-7xkcx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w0-cb9a07-openshift-default-5cf9754dc9-7pw84

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cb9a07-546ff77d99-fxjpt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cb9a07-d74f7465c-pcn8h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-7f8596-openshift-default-7d6dd886c-6mr6z

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-7f8596-7fcc86599-d9fhg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-7f8596-75c9bf4785-kmxxz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8bec73-74b4bf6479-9vmvq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8bec73-6b85599f55-5vzdh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-8bec73-openshift-default-5bb9f8ccd5-nc722

Killing

Stopping container istio-proxy