Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-rjnqr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-rjnqr to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0836c883-openshift-default-56665d7c5-hthqp to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk to ip-10-0-143-18.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-hcfqp

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-hcfqp to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt to ip-10-0-142-138.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68dd7b898ft92xg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68dd7b898ft92xg to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc to ip-10-0-142-138.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7f5b5d7667-wmq8s to ip-10-0-143-18.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7f5b5d7667-p5687 to ip-10-0-142-105.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7f5b5d7667-98dd8 to ip-10-0-142-138.ec2.internal

cert-manager

cert-manager-cainjector

ClusterIPNotAllocated

Cluster IP [IPv4]: 172.31.236.195 is not allocated; repairing

cert-manager

cert-manager-webhook-5dbbbf75cc-bfswl

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-bfswl to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

Scheduled

Successfully assigned openshift-ingress/e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28 to ip-10-0-143-18.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-wlb56

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-wlb56 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g to ip-10-0-142-105.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-bl7jf

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-bl7jf to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs to ip-10-0-143-18.ec2.internal

kuadrant-system

authorino-57f7f8659f-x7t56

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-x7t56 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k to ip-10-0-142-105.ec2.internal

kuadrant-system

authorino-5d59685b8f-lbdsm

Scheduled

Successfully assigned kuadrant-system/authorino-5d59685b8f-lbdsm to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2 to ip-10-0-142-105.ec2.internal

kuadrant-system

authorino-6889cbd8c4-8qghd

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-8qghd to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j to ip-10-0-142-105.ec2.internal

kuadrant-system

authorino-68f9555bd6-jmjc6

Scheduled

Successfully assigned kuadrant-system/authorino-68f9555bd6-jmjc6 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s to ip-10-0-142-105.ec2.internal

kuadrant-system

authorino-6f6944bcdd-xh6qt

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-xh6qt to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd to ip-10-0-142-138.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-h4nph

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-h4nph to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-pjj5c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-pjj5c to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx to ip-10-0-143-18.ec2.internal

opendatahub

test-curl-7380-ca6130

Scheduled

Successfully assigned opendatahub/test-curl-7380-ca6130 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949 to ip-10-0-142-105.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-lfxxm

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-lfxxm to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-eb5531-685c6657f6-kv7kw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-eb5531-685c6657f6-kv7kw to ip-10-0-142-138.ec2.internal

opendatahub

test-curl-7377-fc21b2

Scheduled

Successfully assigned opendatahub/test-curl-7377-fc21b2 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-8qkg2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-8qkg2 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-c3ad80-79c456576-c6ktq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-c3ad80-79c456576-c6ktq to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-849669-f9698874b-mvl59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-849669-f9698874b-mvl59 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-bebfd6-74db98c9b-mchqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-bebfd6-74db98c9b-mchqr to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-b920f1-55844597bb-bgsl4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b920f1-55844597bb-bgsl4 to ip-10-0-142-105.ec2.internal

opendatahub

test-curl-7377-edefe4

Scheduled

Successfully assigned opendatahub/test-curl-7377-edefe4 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-derive-64715175-openshift-default-68586dc669-pp5wt

Scheduled

Successfully assigned openshift-ingress/e2e-derive-64715175-openshift-default-68586dc669-pp5wt to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-mv258

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-mv258 to ip-10-0-142-138.ec2.internal

opendatahub

test-curl-7377-e41327

Scheduled

Successfully assigned opendatahub/test-curl-7377-e41327 to ip-10-0-142-105.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-djkzl

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-djkzl to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-4093c5-76f9565568-t5dcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-4093c5-76f9565568-t5dcf to ip-10-0-142-105.ec2.internal

openshift-ingress

router-default-7d8f76c5df-xxgbt

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-7d8f76c5df-xxgbt

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-7d8f76c5df-xxgbt

Scheduled

Successfully assigned openshift-ingress/router-default-7d8f76c5df-xxgbt to ip-10-0-142-105.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-j2qgw

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-j2qgw to ip-10-0-142-105.ec2.internal

opendatahub

test-curl-7377-d48c42

Scheduled

Successfully assigned opendatahub/test-curl-7377-d48c42 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk to ip-10-0-142-138.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7h64q

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7h64q to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-xqd8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-xqd8z to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-0190d8-7fc6795d84-mc66q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-0190d8-7fc6795d84-mc66q to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-bae155-57bd48f8d-hrc7w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-bae155-57bd48f8d-hrc7w to ip-10-0-143-18.ec2.internal

opendatahub

test-curl-7377-c7fbc8

Scheduled

Successfully assigned opendatahub/test-curl-7377-c7fbc8 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd to ip-10-0-142-138.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-9bcsr

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-9bcsr to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt to ip-10-0-142-105.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-zphmt

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-zphmt to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg to ip-10-0-143-18.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-pzz7z

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-pzz7z to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-mhqgv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-mhqgv to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx to ip-10-0-142-105.ec2.internal

opendatahub

test-curl-7377-705b28

Scheduled

Successfully assigned opendatahub/test-curl-7377-705b28 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-737f64-fc5944d86-msl4c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-737f64-fc5944d86-msl4c to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-3f5339-7df9788c5d-xsh59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-3f5339-7df9788c5d-xsh59 to ip-10-0-142-105.ec2.internal

openshift-jobset-operator

jobset-controller-manager-7bcfbd779f-sq2j8

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-7bcfbd779f-sq2j8 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6d9258eb-dfc68b778-ll5ln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6d9258eb-dfc68b778-ll5ln to ip-10-0-142-138.ec2.internal

opendatahub

test-curl-7377-046df7

Scheduled

Successfully assigned opendatahub/test-curl-7377-046df7 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-mt-26b7d22d-847d68b766-gn5ts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-26b7d22d-847d68b766-gn5ts to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-3b30fbca-c566f6dfb-gxztv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-3b30fbca-c566f6dfb-gxztv to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-eaee54-8677d59954-z8xbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eaee54-8677d59954-z8xbl to ip-10-0-142-138.ec2.internal

opendatahub

test-curl-7374-ae6196

Scheduled

Successfully assigned opendatahub/test-curl-7374-ae6196 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-rfh77

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-rfh77 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-eaee54-769cd9f99b-zz5dj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eaee54-769cd9f99b-zz5dj to ip-10-0-142-105.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-cdwnb

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cdwnb to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78 to ip-10-0-142-105.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-cgqsn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-cgqsn to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc to ip-10-0-142-105.ec2.internal

opendatahub

maas-controller-766c7d8b8c-fjggq

Scheduled

Successfully assigned opendatahub/maas-controller-766c7d8b8c-fjggq to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf to ip-10-0-142-105.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-kzmlb

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-kzmlb to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-a51616-cb69f88f4-mwffs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-a51616-cb69f88f4-mwffs to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-derive-64715175-5c578494d4-9s9nc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-64715175-5c578494d4-9s9nc to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-autores-3e23ec-695bdf4db-2g5c6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-3e23ec-695bdf4db-2g5c6 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-7qlvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-7qlvl to ip-10-0-142-105.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-7htsq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7htsq to ip-10-0-143-18.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-spdnv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-spdnv to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2 to ip-10-0-142-105.ec2.internal

openshift-ingress

kube-auth-proxy-775b454769-p6rqz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-775b454769-p6rqz to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24 to ip-10-0-142-138.ec2.internal

openshift-ingress

kube-auth-proxy-775b454769-rmhb5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-775b454769-rmhb5 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-2924z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-2924z to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-2fp7s to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-6tssr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-6tssr to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-7kff2 to ip-10-0-142-138.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-f9zsw

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-f9zsw to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-88gr7 to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-b79r6 to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-bqj6z to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-cnpvg to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-fp4jz to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-fqn85 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-fwdcl to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-gbglk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-gbglk to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-gsftv to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-hpp9t to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25 to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-j2htj to ip-10-0-142-105.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-mz9p2

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-mz9p2 to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-mnfsj to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-mnsct

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-mnsct to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-nzsvg to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-rkv2s to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-tcnb5 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-tjjd2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-tjjd2 to ip-10-0-143-18.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-tzctd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-tzctd to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-wmtjm to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b7bf55-67c674978c-hv7pq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b7bf55-67c674978c-hv7pq to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-648839-74684687fd-4ks77

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-648839-74684687fd-4ks77 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-wvl6d to ip-10-0-142-138.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sgsbm

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sgsbm to ip-10-0-142-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-z262d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-z262d to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl to ip-10-0-142-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-z7kbc to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p to ip-10-0-142-105.ec2.internal

opendatahub

maas-controller-58dd8456b9-k6mxw

Scheduled

Successfully assigned opendatahub/maas-controller-58dd8456b9-k6mxw to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

Scheduled

Successfully assigned openshift-ingress/e2e-noten-afbe5f-openshift-default-666c6686c5-82b59 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-lhsgh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-lhsgh to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-gb6sx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-gb6sx to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj to ip-10-0-142-105.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-c4xpn

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-c4xpn to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b7bf55-778fbdd574-wxpqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b7bf55-778fbdd574-wxpqj to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-648839-5d876b7fc6-kmjqz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-648839-5d876b7fc6-kmjqz to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5da940-9b8c97cf4-jtlzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5da940-9b8c97cf4-jtlzp to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-73dffe-84d65777b6-rvcg5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-73dffe-84d65777b6-rvcg5 to ip-10-0-142-105.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-6bd8768855-bg4vn

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6bd8768855-bg4vn to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5da940-59d67579bd-bjkq8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5da940-59d67579bd-bjkq8 to ip-10-0-142-105.ec2.internal

opendatahub

test-curl-7374-755b13

Scheduled

Successfully assigned opendatahub/test-curl-7374-755b13 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-45f11c-88685759d-hlhng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-45f11c-88685759d-hlhng to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-45f11c-667b8cfd76-ph74p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-45f11c-667b8cfd76-ph74p to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-58826b-656cf46db6-5cln6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-58826b-656cf46db6-5cln6 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp to ip-10-0-142-138.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-99czt

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-99czt to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-caa7a0-5887fc4698-bsrkb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-caa7a0-5887fc4698-bsrkb to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-kfvvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-kfvvk to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-648839-openshift-default-66c78757c-sg68w to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-s8prt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-s8prt to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-90364398-5454d7d8f9-5qv2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-90364398-5454d7d8f9-5qv2n to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-k9xn7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-k9xn7 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-9lgdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-9lgdr to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-93525b-776fd76f5f-bxfnf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-93525b-776fd76f5f-bxfnf to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-lv5td

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-lv5td to ip-10-0-142-105.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-rm9l2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-rm9l2 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-58826b-79666845f5-2lldb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-58826b-79666845f5-2lldb to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-5389d2-67c9c84b9d-xk7p8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-5389d2-67c9c84b9d-xk7p8 to ip-10-0-142-138.ec2.internal

opendatahub

test-curl-7374-21cb27

Scheduled

Successfully assigned opendatahub/test-curl-7374-21cb27 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-a51616-8bb96fd47-rz67x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-a51616-8bb96fd47-rz67x to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-q4r4z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-q4r4z to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-bae155-56867f4547-67cxs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-bae155-56867f4547-67cxs to ip-10-0-143-18.ec2.internal

models-as-a-service

payload-processing-external-model-66bb89db4d-xrxfp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-66bb89db4d-xrxfp to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv to ip-10-0-142-138.ec2.internal

models-as-a-service

payload-processing-external-model-7d6cb769d7-w5fnm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7d6cb769d7-w5fnm to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-2wdhk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-2wdhk to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-wb5cv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-wb5cv to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-f4jrq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-f4jrq to ip-10-0-142-138.ec2.internal

models-as-a-service

payload-processing-external-model-8677757f86-6cj5s

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-8677757f86-6cj5s to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-dfpbb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-dfpbb to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-p8vjk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-p8vjk to ip-10-0-142-138.ec2.internal

cert-manager

cert-manager-597b95cb84-j48dx

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-j48dx to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-rw296

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-rw296 to ip-10-0-142-105.ec2.internal

models-as-a-service

payload-processing-external-model-8677757f86-88dkv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-8677757f86-88dkv to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-t7b7z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-t7b7z to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-s6l4w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-s6l4w to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c92679-569cdb57b8-6k75b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c92679-569cdb57b8-6k75b to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-48e1f1-747bcf8766-hv7r6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-48e1f1-747bcf8766-hv7r6 to ip-10-0-142-105.ec2.internal

models-as-a-service

payload-processing-external-model-975fcdbd8-xblrk

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-975fcdbd8-xblrk to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-6rkmz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-6rkmz to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-45557

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-45557 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-5ps22

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-5ps22 to ip-10-0-142-138.ec2.internal

opendatahub

odh-model-controller-769875db56-sthrh

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-sthrh to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ffea51-55c47c4df4-kfzjk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ffea51-55c47c4df4-kfzjk to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-dd0ff7-5956655cf6-lhbck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-dd0ff7-5956655cf6-lhbck to ip-10-0-142-138.ec2.internal

models-as-a-service

payload-processing-external-model-c985fc668-s84bg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-c985fc668-s84bg to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9d71fa-7b546b4f74-lhg2c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9d71fa-7b546b4f74-lhg2c to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6 to ip-10-0-142-105.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-pwfqv

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-pwfqv to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-jrpg6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-jrpg6 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-vbg68

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-vbg68 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-vkgvm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-vkgvm to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-fgzz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-fgzz4 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-648839-d96cf595f-qcrtl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-648839-d96cf595f-qcrtl to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-rc7dj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-rc7dj to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx to ip-10-0-142-138.ec2.internal

opendatahub

ai-gateway-controller-6558dd845f-gqggd

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6558dd845f-gqggd to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-gjl5r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-gjl5r to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-nh6jn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-nh6jn to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-49q2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-49q2m to ip-10-0-142-105.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-6gvc9

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-6gvc9 to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-8lm4q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-8lm4q to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-ctrhm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-ctrhm to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-g9jbk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-g9jbk to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-6d87b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-6d87b to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-6xcpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-6xcpk to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-lbdm6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-lbdm6 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-qsggj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-qsggj to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq to ip-10-0-142-105.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-kvk9h

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-kvk9h to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-dpg78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-dpg78 to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746 to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn to ip-10-0-142-138.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-64c77

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-64c77 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6 to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m to ip-10-0-143-18.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-bqrn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-bqrn5 to ip-10-0-143-18.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-8t6zk

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-8t6zk to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx to ip-10-0-142-138.ec2.internal

openshift-ingress

payload-processing-e2e-ait-90364398-77778cb55d-d7kzd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-90364398-77778cb55d-d7kzd to ip-10-0-143-18.ec2.internal

openshift-ingress

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8 to ip-10-0-142-138.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-hckkh

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-hckkh to ip-10-0-142-105.ec2.internal

openshift-ingress

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-84fed1-5f977c9ccd-m4689

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-84fed1-5f977c9ccd-m4689 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-93525b-79bcbb556b-4pnw8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-93525b-79bcbb556b-4pnw8 to ip-10-0-142-138.ec2.internal

openshift-ingress

e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8 to ip-10-0-142-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c8bb87-57c496478-pg4g6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c8bb87-57c496478-pg4g6 to ip-10-0-142-105.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7d8f76c5df from 0 to 1

openshift-ingress

replicaset-controller

router-default-7d8f76c5df

SuccessfulCreate

Created pod: router-default-7d8f76c5df-xxgbt

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x5)

openshift-ingress

kubelet

router-default-7d8f76c5df-xxgbt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7d8f76c5df-xxgbt

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x4)

openshift-ingress

kubelet

router-default-7d8f76c5df-xxgbt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-7d8f76c5df-xxgbt

Started

Container started

openshift-ingress

kubelet

router-default-7d8f76c5df-xxgbt

Created

Container created

openshift-ingress

kubelet

router-default-7d8f76c5df-xxgbt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-7d8f76c5df-xxgbt

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-cgqsn

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cgqsn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-cgqsn

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cgqsn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.508s (2.508s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cgqsn

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cgqsn

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cgqsn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cgqsn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-6bd8768855

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-6bd8768855-bg4vn

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-6bd8768855 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-6bd8768855-bg4vn

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-bg4vn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.595s (7.595s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-bg4vn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.812s (6.812s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-bg4vn

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-bg4vn

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-pwfqv

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-pwfqv

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-pwfqv

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-hcfqp

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-pwfqv

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-pwfqv

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-pwfqv

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 1.628s (1.628s including waiting). Image size: 224874686 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-hcfqp

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-hcfqp

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-hcfqp

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.968s (2.968s including waiting). Image size: 309650901 bytes.
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-hcfqp

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-hcfqp

Started

Container started

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-bfswl

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-bfswl

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bfswl

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bfswl

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.023s (3.023s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bfswl

Created

Container created

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-j48dx

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bfswl

Started

Container started

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-7f5b5d7667 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7f5b5d7667

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7f5b5d7667

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7f5b5d7667-98dd8

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7f5b5d7667

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7f5b5d7667-p5687

cert-manager

kubelet

cert-manager-597b95cb84-j48dx

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

kubelet

cert-manager-597b95cb84-j48dx

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7f5b5d7667-p5687

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

cert-manager

multus

cert-manager-597b95cb84-j48dx

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

kubelet

cert-manager-597b95cb84-j48dx

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-pwfqv_152d48a8-1185-4a4a-8f46-672900455729 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.851s (2.851s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.78s (2.78s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.865s (2.865s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub-operator-system

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s_6ffbf59f-de5e-4bfc-95fb-3c7c76eb3dba

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s_6ffbf59f-de5e-4bfc-95fb-3c7c76eb3dba became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 288ms (288ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-98dd8

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-wmq8s

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 366ms (366ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 324ms (324ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5b5d7667-p5687

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-lfxxm

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-lfxxm

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lfxxm

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lfxxm

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lfxxm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.598s (2.598s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-lfxxm_6b41ed94-119e-4abc-a3ad-6fa21ff24b79

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-lfxxm_6b41ed94-119e-4abc-a3ad-6fa21ff24b79 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lfxxm

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-7h64q

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7h64q

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-7h64q

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-pzz7z

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-pzz7z

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pzz7z

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pzz7z

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.523s (1.523s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7h64q

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.897s (3.897s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7h64q_4b70b01a-ff6e-450a-89cb-adc06109a326

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-7h64q_4b70b01a-ff6e-450a-89cb-adc06109a326 became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7h64q

Started

Container started

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-h4nph

kuadrant-system

multus

authorino-operator-7b7bb4bc77-h4nph

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

limitador-operator-controller-manager-5778bb4449-pzz7z_4d6f2a77-b0b0-4fce-8678-f05e89f3596f

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-pzz7z_4d6f2a77-b0b0-4fce-8678-f05e89f3596f became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-h4nph

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pzz7z

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pzz7z

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7h64q

Created

Container created

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-djkzl

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-h4nph

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.39s (1.39s including waiting). Image size: 167738465 bytes.

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-djkzl

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-djkzl

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

authorino-operator-7b7bb4bc77-h4nph_de28c993-604d-4d49-9813-f843dd937de0

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-h4nph_de28c993-604d-4d49-9813-f843dd937de0 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-djkzl

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-djkzl

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-djkzl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.554s (4.554s including waiting). Image size: 342538866 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

replicaset-controller

kube-auth-proxy-775b454769

SuccessfulCreate

Created pod: kube-auth-proxy-775b454769-rmhb5

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-775b454769 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-775b454769

SuccessfulCreate

Created pod: kube-auth-proxy-775b454769-p6rqz

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-2dkrn"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-9scnq"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898ft92xg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898ft92xg

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898ft92xg

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68dd7b898ft92xg

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-775b454769-rmhb5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68dd7b898f from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68dd7b898f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68dd7b898ft92xg

openshift-ingress

multus

kube-auth-proxy-775b454769-p6rqz

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-775b454769-p6rqz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-ingress

multus

kube-auth-proxy-775b454769-rmhb5

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9bcsr

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

openshift-jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

multus

limitador-limitador-74dfcfb894-9bcsr

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-9bcsr

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-zphmt

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-ingress

kubelet

kube-auth-proxy-775b454769-p6rqz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.43s (2.43s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-775b454769-p6rqz

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-775b454769-p6rqz

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-775b454769-rmhb5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.592s (2.592s including waiting). Image size: 188904677 bytes.

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-bl7jf

kuadrant-system

multus

authorino-57f7f8659f-x7t56

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-x7t56

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-7bcfbd779f from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-x7t56

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-7bcfbd779f

SuccessfulCreate

Created pod: jobset-controller-manager-7bcfbd779f-sq2j8

openshift-jobset-operator

kubelet

jobset-controller-manager-7bcfbd779f-sq2j8

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-ingress

kubelet

kube-auth-proxy-775b454769-rmhb5

Created

Container created

openshift-jobset-operator

multus

jobset-controller-manager-7bcfbd779f-sq2j8

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-775b454769-rmhb5

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-bl7jf

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-bl7jf

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-7c9b87d574-zphmt

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-zphmt

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9bcsr

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9bcsr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.41s (2.41s including waiting). Image size: 133379307 bytes.

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-64c77

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-x7t56

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-x7t56

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-x7t56

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.63s (1.63s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-bl7jf

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-bl7jf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.452s (1.452s including waiting). Image size: 204096810 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-64c77

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-64c77

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-zphmt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.017s (1.017s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9bcsr

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-zphmt

Created

Container created

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-zphmt

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-bl7jf

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-x7t56

openshift-jobset-operator

kubelet

jobset-controller-manager-7bcfbd779f-sq2j8

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-7bcfbd779f-sq2j8

Started

Container started

openshift-jobset-operator

jobset-controller-manager-7bcfbd779f-sq2j8_ecb0fc48-f24c-4b10-ab48-ea50502b8ba3

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-7bcfbd779f-sq2j8_ecb0fc48-f24c-4b10-ab48-ea50502b8ba3 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-7bcfbd779f-sq2j8

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.504s (2.504s including waiting). Image size: 182184678 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-x7t56

Killing

Stopping container authorino

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-64c77

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-64c77

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.272s (2.272s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-64c77

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9bcsr

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-9bcsr

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

opendatahub

kserve-module-controller-manager-7566cf5fc8-64c77_722a1216-d45f-41e9-bd38-a95ddec95322

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-64c77_722a1216-d45f-41e9-bd38-a95ddec95322 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-766c7d8b8c from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-58dd8456b9 from 0 to 1

opendatahub

replicaset-controller

maas-controller-766c7d8b8c

SuccessfulCreate

Created pod: maas-controller-766c7d8b8c-fjggq

opendatahub

multus

maas-controller-766c7d8b8c-fjggq

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-58dd8456b9

SuccessfulCreate

Created pod: maas-controller-58dd8456b9-k6mxw

opendatahub

kubelet

maas-controller-58dd8456b9-k6mxw

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:34275440615a8254e0ca8697e90ea60c6c1ae63ccdbfa28f8eb5afcac7dec997"

opendatahub

kubelet

maas-controller-766c7d8b8c-fjggq

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:34275440615a8254e0ca8697e90ea60c6c1ae63ccdbfa28f8eb5afcac7dec997"

opendatahub

multus

maas-controller-58dd8456b9-k6mxw

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-58dd8456b9-k6mxw

Started

Container started

opendatahub

kubelet

maas-controller-58dd8456b9-k6mxw

Created

Container created

opendatahub

kubelet

maas-controller-58dd8456b9-k6mxw

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:34275440615a8254e0ca8697e90ea60c6c1ae63ccdbfa28f8eb5afcac7dec997" in 2.787s (2.787s including waiting). Image size: 200063998 bytes.

opendatahub

kubelet

maas-controller-766c7d8b8c-fjggq

Started

Container started

opendatahub

kubelet

maas-controller-766c7d8b8c-fjggq

Created

Container created

opendatahub

kubelet

maas-controller-766c7d8b8c-fjggq

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:34275440615a8254e0ca8697e90ea60c6c1ae63ccdbfa28f8eb5afcac7dec997" in 2.99s (2.99s including waiting). Image size: 200063998 bytes.

opendatahub

maas-controller-766c7d8b8c-fjggq_fd3cf9e9-b3b1-48c8-849e-b72dcc204127

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-766c7d8b8c-fjggq_fd3cf9e9-b3b1-48c8-849e-b72dcc204127 became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-wlb56

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-kvk9h

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-spdnv

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wlb56

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-wlb56

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-spdnv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-spdnv

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-hckkh

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-hckkh

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-j2qgw

opendatahub

multus

odh-model-controller-769875db56-sthrh

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-sthrh

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-sthrh

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

multus

kserve-controller-manager-776cc66d47-kvk9h

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kvk9h

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-hckkh

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

multus

model-serving-api-75bd89fdfc-j2qgw

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-j2qgw

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-spdnv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.328s (2.328s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-spdnv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-spdnv

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-cgqsn

opendatahub

odh-model-controller-769875db56-sthrh_920170d2-7849-4a59-b424-f10a7bf07a45

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-sthrh_920170d2-7849-4a59-b424-f10a7bf07a45 became leader

opendatahub

kubelet

odh-model-controller-769875db56-sthrh

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-sthrh

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cgqsn

Killing

Stopping container discovery

opendatahub

kubelet

model-serving-api-75bd89fdfc-j2qgw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.015s (3.015s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-sthrh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.529s (2.529s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-j2qgw

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-j2qgw

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kvk9h

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-hckkh

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kvk9h

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.85s (3.85s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-hckkh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.521s (3.521s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kvk9h

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-hckkh

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-kvk9h_f12f65e8-ba37-4c34-b2e5-4e952eb7a20b

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-kvk9h_f12f65e8-ba37-4c34-b2e5-4e952eb7a20b became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-hckkh_5defee2f-228e-448c-915f-3c96b49f5fd6

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-hckkh_5defee2f-228e-448c-915f-3c96b49f5fd6 became leader

opendatahub

kubelet

maas-controller-766c7d8b8c-fjggq

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-766c7d8b8c

SuccessfulDelete

Deleted pod: maas-controller-766c7d8b8c-fjggq

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-766c7d8b8c from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wlb56

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wlb56

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 11.594s (11.594s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wlb56

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

maas-controller-58dd8456b9-k6mxw_12e0464a-70e9-40c3-b9cb-848ae7813843

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-58dd8456b9-k6mxw_12e0464a-70e9-40c3-b9cb-848ae7813843 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-xh6qt

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-xh6qt

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-8qghd

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-68f9555bd6 from 0 to 1

kuadrant-system

replicaset-controller

authorino-68f9555bd6

SuccessfulCreate

Created pod: authorino-68f9555bd6-jmjc6

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-8qghd

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

multus

authorino-68f9555bd6-jmjc6

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-nzsvg
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-68f9555bd6-jmjc6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 1 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-b79r6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

Created

Container created

kuadrant-system

kubelet

authorino-68f9555bd6-jmjc6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.567s (2.567s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

Created

Container created

kuadrant-system

kubelet

authorino-68f9555bd6-jmjc6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.566s (2.566s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

Created

Container created

kuadrant-system

kubelet

authorino-68f9555bd6-jmjc6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.189s (3.189s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-bl7jf

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-bl7jf

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

ProbeError

Startup probe error: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z7kbc

Unhealthy

Startup probe failed: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8t6zk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 311ms (311ms including waiting). Image size: 235100981 bytes.

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-8t6zk

opendatahub

multus

llmisvc-controller-manager-6466c554d8-8t6zk

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8t6zk

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8t6zk

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8t6zk

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-hckkh

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-hckkh

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-6gvc9

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

multus

ai-gateway-controller-7d85675f98-6gvc9

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-6gvc9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

ai-gateway-controller-7d85675f98-6gvc9_1b7cbcdd-7407-497e-a904-c9bab5571405

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-6gvc9_1b7cbcdd-7407-497e-a904-c9bab5571405 became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-6gvc9

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-6gvc9

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-6gvc9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.757s (1.757s including waiting). Image size: 183888297 bytes.

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-bqrn5

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-kfvvk

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-kfvvk

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-kfvvk

openshift-ingress

multus

payload-processing-5f78687d5b-bqrn5

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-bqrn5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-bqrn5

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-bqrn5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-kfvvk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-kfvvk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-kfvvk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.307s (2.307s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-bqrn5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.257s (2.257s including waiting). Image size: 125317101 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-6558dd845f

SuccessfulCreate

Created pod: ai-gateway-controller-6558dd845f-gqggd

opendatahub

kubelet

ai-gateway-controller-6558dd845f-gqggd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6558dd845f from 0 to 1

opendatahub

multus

ai-gateway-controller-6558dd845f-gqggd

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

opendatahub

llmisvc-controller-manager-6466c554d8-8t6zk_6f98a8fb-3bc8-46c4-82d8-01e5b18121c8

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-8t6zk_6f98a8fb-3bc8-46c4-82d8-01e5b18121c8 became leader

opendatahub

kubelet

ai-gateway-controller-6558dd845f-gqggd

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6558dd845f-gqggd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 362ms (362ms including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-6558dd845f-gqggd

Created

Container created

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-6gvc9

opendatahub

kubelet

ai-gateway-controller-7d85675f98-6gvc9

Killing

Stopping container manager

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-cdwnb

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-cdwnb

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-cdwnb

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-cdwnb

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-cdwnb

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-cdwnb

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.267s (1.267s including waiting). Image size: 98346788 bytes.

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-kzmlb

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-kzmlb

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kzmlb

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kzmlb

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kzmlb

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 176ms (176ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kzmlb

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-f9zsw

Started

Container started

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-f9zsw

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-f9zsw

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-f9zsw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-f9zsw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 179ms (179ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-f9zsw

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-mz9p2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 186ms (186ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-mz9p2

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-mz9p2

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-mz9p2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-mz9p2

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-mz9p2

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sgsbm

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sgsbm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sgsbm

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sgsbm

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sgsbm

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sgsbm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.009s (1.009s including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-c4xpn

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

multus

echo-simulator-kserve-64b6f8f96c-c4xpn

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c4xpn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

opendatahub

ai-gateway-controller-6558dd845f-gqggd_24df0f9e-525f-47e8-8505-d33338477e78

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6558dd845f-gqggd_24df0f9e-525f-47e8-8505-d33338477e78 became leader

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c4xpn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.429s (1.429s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-99czt

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-99czt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 215ms (215ms including waiting). Image size: 98346788 bytes.

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-99czt

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c4xpn

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-99czt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c4xpn

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-99czt

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-99czt

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 194ms (194ms including waiting). Image size: 98346788 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-gbglk

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-fqn85

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 4 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gbglk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gbglk

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gbglk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-gbglk

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

kuadrant-system

replicaset-controller

authorino-5d59685b8f

SuccessfulCreate

Created pod: authorino-5d59685b8f-lbdsm
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gbglk

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gbglk

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

kuadrant-system

multus

authorino-5d59685b8f-lbdsm

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5d59685b8f-lbdsm

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

kuadrant-system

kubelet

authorino-5d59685b8f-lbdsm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 978ms (978ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5d59685b8f-lbdsm

Created

Container created

kuadrant-system

kubelet

authorino-5d59685b8f-lbdsm

Started

Container started

kuadrant-system

replicaset-controller

authorino-68f9555bd6

SuccessfulDelete

Deleted pod: authorino-68f9555bd6-jmjc6

kuadrant-system

kubelet

authorino-68f9555bd6-jmjc6

Killing

Stopping container authorino
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-68f9555bd6 from 1 to 0

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-mnsct

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnsct

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-mnsct

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnsct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnsct

Created

Container created
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnsct

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnsct

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-0836c883

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0836c883

openshift-ingress

replicaset-controller

e2e-ait-0836c883-openshift-default-56665d7c5

SuccessfulCreate

Created pod: e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

openshift-ingress

deployment-controller

e2e-ait-0836c883-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0836c883-openshift-default-56665d7c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f

SuccessfulCreate

Created pod: e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

openshift-ingress

multus

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-3b30fbca-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-3b30fbca-gw-openshift-default-746d97988f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-3b30fbca-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-3b30fbca-gw

openshift-ingress

deployment-controller

e2e-ait-14a5c09a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-14a5c09a-openshift-default-fc9fb49f7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-14a5c09a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-14a5c09a

openshift-ingress

replicaset-controller

e2e-ait-14a5c09a-openshift-default-fc9fb49f7

SuccessfulCreate

Created pod: e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

openshift-ingress

multus

e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0836c883

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0836c883-68c48d468d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0836c883-68c48d468d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0836c883

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0836c883-7b4877479f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0836c883-7b4877479f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9

openshift-ingress

multus

payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0836c883-68c48d468d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0836c883-68c48d468d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0836c883: serviceaccount "payload-processing-e2e-ait-0836c883" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0836c883-7b4877479f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0836c883-7b4877479f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0836c883: serviceaccount "payload-processing-e2e-ait-0836c883" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-3b30fbca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-3b30fbca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-3b30fbca-c566f6dfb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3b30fbca-c566f6dfb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-3b30fbca-c566f6dfb-gxztv

openshift-ingress

multus

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx

openshift-ingress

multus

payload-processing-e2e-migrate-3b30fbca-c566f6dfb-gxztv

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-3b30fbca-c566f6dfb-gxztv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-3b30fbca-c566f6dfb-gxztv

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3b30fbca: serviceaccount "payload-processing-e2e-migrate-3b30fbca" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3b30fbca-c566f6dfb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-3b30fbca-c566f6dfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3b30fbca: serviceaccount "payload-processing-e2e-migrate-3b30fbca" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-3b30fbca-c566f6dfb-gxztv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.523s (2.523s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.74s (2.74s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-14a5c09a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.256s (1.256s including waiting). Image size: 125317101 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-14a5c09a: serviceaccount "payload-processing-e2e-ait-14a5c09a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-s8prt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-14a5c09a-857c94954b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-14a5c09a-857c94954b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-14a5c09a: serviceaccount "payload-processing-e2e-ait-14a5c09a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-14a5c09a-857c94954b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx

openshift-ingress

deployment-controller

payload-processing-e2e-ait-14a5c09a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-14a5c09a-857c94954b from 0 to 1

openshift-ingress

deployment-controller

e2e-derive-64715175-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-64715175-openshift-default-68586dc669 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-90364398-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-90364398-openshift-default-d8c6b865c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-s8prt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ait-90364398-openshift-default-d8c6b865c

SuccessfulCreate

Created pod: e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

openshift-ingress

gateway_labeler_controller

e2e-ait-90364398

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-90364398

openshift-ingress

kubelet

payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-derive-64715175

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-64715175

openshift-ingress

replicaset-controller

e2e-derive-64715175-openshift-default-68586dc669

SuccessfulCreate

Created pod: e2e-derive-64715175-openshift-default-68586dc669-pp5wt

openshift-ingress

kubelet

payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-s8prt

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-s8prt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-s8prt

Created

Container created

openshift-ingress

multus

e2e-derive-64715175-openshift-default-68586dc669-pp5wt

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-64715175

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-64715175-d8659cfcf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-64715175-d8659cfcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-64715175-d8659cfcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-64715175: serviceaccount "payload-processing-e2e-derive-64715175" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-64715175

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-64715175-5c578494d4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-64715175-5c578494d4

FailedCreate

Error creating: pods "payload-processing-e2e-derive-64715175-5c578494d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-64715175: serviceaccount "payload-processing-e2e-derive-64715175" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-64715175-d8659cfcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q

openshift-ingress

kubelet

payload-processing-e2e-derive-64715175-5c578494d4-9s9nc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-64715175-5c578494d4-9s9nc

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-64715175-5c578494d4

SuccessfulCreate

Created pod: payload-processing-e2e-derive-64715175-5c578494d4-9s9nc

openshift-ingress

kubelet

payload-processing-e2e-derive-64715175-5c578494d4-9s9nc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-64715175-5c578494d4-9s9nc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-90364398-77778cb55d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-90364398-77778cb55d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-90364398: serviceaccount "payload-processing-e2e-ait-90364398" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.049s (2.049s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-90364398-77778cb55d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-90364398-77778cb55d-d7kzd

openshift-ingress

deployment-controller

payload-processing-e2e-ait-90364398

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-90364398-77778cb55d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-90364398-5454d7d8f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-90364398-5454d7d8f9-5qv2n
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-90364398-5454d7d8f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-90364398-5454d7d8f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-90364398: serviceaccount "payload-processing-e2e-ait-90364398" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-90364398

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-90364398-5454d7d8f9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-90364398-5454d7d8f9-5qv2n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-90364398-5454d7d8f9-5qv2n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-90364398-77778cb55d-d7kzd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-90364398-77778cb55d-d7kzd

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ait-90364398-77778cb55d-d7kzd

Created

Container created

openshift-ingress

kubelet

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ait-90364398-77778cb55d-d7kzd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-90364398-5454d7d8f9-5qv2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-90364398-5454d7d8f9-5qv2n

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

Started

Container started

openshift-ingress

kubelet

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-90364398-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-90364398-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-3b30fbca-c566f6dfb-gxztv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0836c883-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-0836c883-68c48d468d-m4r5r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3b30fbca-79f6f6576c-khhrx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0836c883-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0836c883-7b4877479f-46bc9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-3b30fbca-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-3b30fbca-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-14a5c09a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-14a5c09a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-64715175-openshift-default-68586dc669-pp5wt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-64715175-openshift-default-68586dc669-pp5wt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-64715175-openshift-default-68586dc669-pp5wt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-14a5c09a-67f66dddbc-s8prt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-3b30fbca-gw-openshift-default-746d97988f-q8tpz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-4e261b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-4e261b

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5
(x2)

openshift-ingress

kubelet

e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-90364398-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-90364398-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-derive-64715175-openshift-default-68586dc669-pp5wt

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-64715175-openshift-default-68586dc669-pp5wt

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-14a5c09a-857c94954b-25fkx

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.49:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-4e261b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0836c883-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0836c883-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4e261b-865f9944fb

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-4e261b-865f9944fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4e261b: serviceaccount "payload-processing-e2e-worker-w3-4e261b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4e261b: serviceaccount "payload-processing-e2e-worker-w3-4e261b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-4e261b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-4e261b-865f9944fb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4e261b-865f9944fb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-14a5c09a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-14a5c09a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-0836c883-openshift-default-56665d7c5-hthqp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-90364398-5454d7d8f9-5qv2n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-90364398-77778cb55d-d7kzd

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-849669

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-849669

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

openshift-ingress

kubelet

e2e-ait-14a5c09a-openshift-default-fc9fb49f7-jp6fn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-90364398-openshift-default-d8c6b865c-9wjt5

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-3ccdab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-3ccdab

openshift-ingress

deployment-controller

e2e-worker-w0-3ccdab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3ccdab-openshift-default-6865b8777c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-3ccdab-openshift-default-6865b8777c

SuccessfulCreate

Created pod: e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-1d9b1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-1d9b1a

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

openshift-ingress

multus

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-64715175-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-64715175-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-849669

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-849669-f9698874b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-849669-f9698874b-mvl59

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-849669

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-849669-587b744455 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-849669-f9698874b-mvl59

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-849669-f9698874b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-849669-f9698874b-mvl59

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-849669-587b744455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-849669-f9698874b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-849669-f9698874b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-849669: serviceaccount "payload-processing-e2e-worker-w4-849669" not found

openshift-ingress

multus

payload-processing-e2e-worker-w4-849669-f9698874b-mvl59

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-849669-f9698874b-mvl59

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-849669-587b744455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-849669-587b744455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-849669: serviceaccount "payload-processing-e2e-worker-w4-849669" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3ccdab: serviceaccount "payload-processing-e2e-worker-w0-3ccdab" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-3ccdab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3ccdab: serviceaccount "payload-processing-e2e-worker-w0-3ccdab" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-3ccdab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-1d9b1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-1d9b1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-1d9b1a-69d786c854 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-1d9b1a-69d786c854

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-1d9b1a: serviceaccount "payload-processing-e2e-worker-w2-1d9b1a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-1d9b1a-69d786c854

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-1d9b1a-69d786c854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-1d9b1a: serviceaccount "payload-processing-e2e-worker-w2-1d9b1a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-64715175-5c578494d4-9s9nc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64715175-d8659cfcf-8hc7q

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-64715175-openshift-default-68586dc669-pp5wt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-64715175-5c578494d4-9s9nc

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.52:50052" within 1s: context deadline exceeded
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-e43a66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-e43a66

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-e43a66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-e43a66-7fdfdb6458 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-e43a66: serviceaccount "payload-processing-e2e-worker-w1-e43a66" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-e43a66: serviceaccount "payload-processing-e2e-worker-w1-e43a66" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-e43a66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-e43a66-867f557b99 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3ccdab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3ccdab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

Created

Container created

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gbglk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-gbglk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-nzsvg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

Started

Container started

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 5 to 7

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

Started

Container started

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

Created

Container created

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-3ccdab-openshift-default-6865b8777c

SuccessfulCreate

Created pod: e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

openshift-ingress

replicaset-controller

e2e-worker-w0-3ccdab-openshift-default-6865b8777c

SuccessfulCreate

Created pod: e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3ccdab-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-3ccdab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3ccdab-openshift-default-6865b8777c from 1 to 3

openshift-ingress

multus

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

Created

Container created

openshift-ingress

multus

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 5 to 7

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx

Created

Container created

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 8 to 7

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-rkv2s

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

ProbeError

Readiness probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

Unhealthy

Readiness probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

Created

Container created

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 4 to 6

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulCreate

Created pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 7 to 5

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

Started

Container started

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

Created

Container created

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-mnsct

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

Started

Container started

openshift-ingress

multus

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnsct

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wmtjm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-wvl6d
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

Unhealthy

Readiness probe failed: Get "https://10.133.0.35:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

openshift-ingress

deployment-controller

e2e-mt-6d9258eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6d9258eb-openshift-default-7b8cd879df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6d9258eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6d9258eb

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

Unhealthy

Readiness probe failed: Get "https://10.133.0.35:8000/ready": context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d9258eb-dfc68b778

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6d9258eb-dfc68b778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d9258eb: serviceaccount "payload-processing-e2e-mt-6d9258eb" not found

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6d9258eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6d9258eb-dfc68b778 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d9258eb: serviceaccount "payload-processing-e2e-mt-6d9258eb" not found

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6d9258eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 6 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wvl6d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d9258eb-dfc68b778

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn

openshift-ingress

multus

payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-3ccdab-openshift-default-6865b8777c

SuccessfulCreate

Created pod: e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3ccdab-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-3ccdab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3ccdab-openshift-default-6865b8777c from 3 to 4

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

Created

Container created
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6tssr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6tssr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-tzctd

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tzctd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tzctd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6tssr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tzctd

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-6tssr

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-71af6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-71af6f

openshift-ingress

replicaset-controller

e2e-api-a-71af6f-openshift-default-795bcf9cf

SuccessfulCreate

Created pod: e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

openshift-ingress

deployment-controller

e2e-api-a-71af6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-71af6f-openshift-default-795bcf9cf from 0 to 1

openshift-ingress

multus

e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6tssr

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6tssr

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tzctd

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tzctd

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-77bfb58f8c-z262d

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-z262d

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z262d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z262d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z262d

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-l5z9f

Unhealthy

Readiness probe failed: Get "https://10.133.0.35:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-71af6f-6cc8cf869b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-71af6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-71af6f-fc55b68f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-71af6f-6cc8cf869b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-71af6f-6cc8cf869b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-71af6f: serviceaccount "payload-processing-e2e-api-a-71af6f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-71af6f-fc55b68f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-k9xn7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-71af6f-fc55b68f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-71af6f: serviceaccount "payload-processing-e2e-api-a-71af6f" not found

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-71af6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-71af6f-6cc8cf869b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-k9xn7

Created

Container created

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

Started

Container started

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-k9xn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-k9xn7

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-k9xn7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

Created

Container created
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z262d

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z262d

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z262d

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z262d

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6d9258eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6d9258eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

Created

Container created

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-7htsq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7htsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7htsq

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7htsq

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-7htsq

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6d9258eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6d9258eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-58826b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-58826b

openshift-ingress

deployment-controller

e2e-api-b-58826b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-58826b-openshift-default-658c574f4f from 0 to 1

openshift-ingress

multus

e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-58826b-openshift-default-658c574f4f

SuccessfulCreate

Created pod: e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

Created

Container created

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-71af6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-71af6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-58826b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-58826b-79666845f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-58826b-79666845f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-58826b-79666845f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-58826b: serviceaccount "payload-processing-e2e-api-b-58826b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-58826b-656cf46db6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-58826b-656cf46db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-58826b: serviceaccount "payload-processing-e2e-api-b-58826b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-58826b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-58826b-656cf46db6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-58826b-79666845f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-58826b-79666845f5-2lldb

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-58826b-656cf46db6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-58826b-656cf46db6-5cln6

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-58826b-79666845f5-2lldb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-58826b-656cf46db6-5cln6

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-58826b-656cf46db6-5cln6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-58826b-79666845f5-2lldb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-58826b-79666845f5-2lldb

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-58826b-656cf46db6-5cln6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-58826b-79666845f5-2lldb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-58826b-656cf46db6-5cln6

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused

opendatahub

kubelet

test-curl-7374-21cb27

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7374-21cb27

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-71af6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-71af6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7374-21cb27

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.896s (2.896s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7374-21cb27

Created

Container created

opendatahub

kubelet

test-curl-7374-21cb27

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-a-93525b-openshift-default-7c9b64476f

SuccessfulCreate

Created pod: e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

openshift-ingress

deployment-controller

e2e-api-a-93525b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-93525b-openshift-default-7c9b64476f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-93525b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-93525b

openshift-ingress

multus

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7374-21cb27

Killing

Stopping container test-curl-7374-21cb27

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-93525b-776fd76f5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-93525b-776fd76f5f-bxfnf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-93525b-79bcbb556b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-93525b-79bcbb556b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-93525b: serviceaccount "payload-processing-e2e-api-a-93525b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-93525b-79bcbb556b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-93525b-79bcbb556b-4pnw8

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-93525b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-93525b-79bcbb556b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-93525b-776fd76f5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-93525b-776fd76f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-93525b: serviceaccount "payload-processing-e2e-api-a-93525b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-93525b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-93525b-776fd76f5f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-93525b-776fd76f5f-bxfnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-93525b-79bcbb556b-4pnw8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-93525b-79bcbb556b-4pnw8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-93525b-776fd76f5f-bxfnf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-93525b-776fd76f5f-bxfnf

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-93525b-79bcbb556b-4pnw8

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-93525b-776fd76f5f-bxfnf

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-93525b-79bcbb556b-4pnw8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-93525b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-93525b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-fw8zn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-sh8mh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-api-b-b7bf55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b7bf55-openshift-default-69cf9bbfb5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-71af6f-fc55b68f9-k9xn7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5

SuccessfulCreate

Created pod: e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

openshift-ingress

gateway_labeler_controller

e2e-api-b-b7bf55

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b7bf55

openshift-ingress

multus

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-71af6f-6cc8cf869b-vp7n8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.111:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b7bf55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b7bf55-778fbdd574 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b7bf55-67c674978c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b7bf55-67c674978c-hv7pq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b7bf55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b7bf55-67c674978c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b7bf55-67c674978c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b7bf55-67c674978c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b7bf55: serviceaccount "payload-processing-e2e-api-b-b7bf55" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b7bf55-778fbdd574

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b7bf55-778fbdd574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b7bf55: serviceaccount "payload-processing-e2e-api-b-b7bf55" not found
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-58826b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b7bf55-778fbdd574

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b7bf55-778fbdd574-wxpqj
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-58826b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b7bf55-67c674978c-hv7pq

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b7bf55-778fbdd574-wxpqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b7bf55-67c674978c-hv7pq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b7bf55-67c674978c-hv7pq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-b7bf55-778fbdd574-wxpqj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b7bf55-67c674978c-hv7pq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-b7bf55-778fbdd574-wxpqj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-b7bf55-778fbdd574-wxpqj

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-93525b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-71af6f-openshift-default-795bcf9cf-qjcwn

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-93525b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b7bf55-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b7bf55-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-nh6jn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d9258eb: serviceaccount "payload-processing-e2e-mt-6d9258eb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6d9258eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d9258eb-dfc68b778

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6d9258eb-dfc68b778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d9258eb: serviceaccount "payload-processing-e2e-mt-6d9258eb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6d9258eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6d9258eb-dfc68b778 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-caa7a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-caa7a0

openshift-ingress

replicaset-controller

e2e-ipp-a-caa7a0-openshift-default-5479f48849

SuccessfulCreate

Created pod: e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d9258eb-dfc68b778

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6d9258eb-dfc68b778-ll5ln

openshift-ingress

deployment-controller

e2e-ipp-a-caa7a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-caa7a0-openshift-default-5479f48849 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-nh6jn

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-nh6jn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-6d9258eb-dfc68b778-ll5ln

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-ll5ln

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-nh6jn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-ll5ln

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-ll5ln

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-nh6jn

Created

Container created

openshift-ingress

multus

e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-58826b-656cf46db6-5cln6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-58826b-79666845f5-2lldb

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-caa7a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-caa7a0-5887fc4698 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-caa7a0: serviceaccount "payload-processing-e2e-ipp-a-caa7a0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-caa7a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-caa7a0-5887fc4698

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-caa7a0-5887fc4698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-caa7a0: serviceaccount "payload-processing-e2e-ipp-a-caa7a0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-caa7a0-5887fc4698

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-caa7a0-5887fc4698-bsrkb

openshift-ingress

multus

payload-processing-e2e-ipp-a-caa7a0-5887fc4698-bsrkb

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-5887fc4698-bsrkb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-t7b7z

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-t7b7z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-t7b7z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-5887fc4698-bsrkb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-5887fc4698-bsrkb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-t7b7z

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-t7b7z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-a-84fed1-openshift-default-7f78d7f9d9

SuccessfulCreate

Created pod: e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

openshift-ingress

deployment-controller

e2e-api-a-84fed1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-84fed1-openshift-default-7f78d7f9d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-84fed1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-84fed1

openshift-ingress

multus

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-93525b-776fd76f5f-bxfnf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-93525b-79bcbb556b-4pnw8

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-84fed1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-84fed1-5f977c9ccd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-84fed1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-84fed1-6d88ff474c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-84fed1-5f977c9ccd-m4689

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-84fed1-6d88ff474c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-9lgdr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-84fed1-6d88ff474c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-84fed1: serviceaccount "payload-processing-e2e-api-a-84fed1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-84fed1-5f977c9ccd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-84fed1-5f977c9ccd-m4689
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-84fed1-5f977c9ccd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-84fed1-5f977c9ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-84fed1: serviceaccount "payload-processing-e2e-api-a-84fed1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-9lgdr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-84fed1-5f977c9ccd-m4689

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-84fed1-5f977c9ccd-m4689

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-84fed1-5f977c9ccd-m4689

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-9lgdr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-9lgdr

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-9lgdr

Started

Container started

openshift-ingress

kubelet

e2e-api-b-58826b-openshift-default-658c574f4f-8m7zc

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7374-ae6196

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7374-ae6196

Created

Container created

opendatahub

kubelet

test-curl-7374-ae6196

Started

Container started

opendatahub

multus

test-curl-7374-ae6196

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7374-ae6196

Killing

Stopping container test-curl-7374-ae6196
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b7bf55-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b7bf55-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

Started

Container started

openshift-ingress

kubelet

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-93525b-openshift-default-7c9b64476f-q49b9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-mt-6d9258eb-dfc68b778-ll5ln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d9258eb-5b9dd56c79-nh6jn

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6d9258eb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-6d9258eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6d9258eb-openshift-default-7b8cd879df from 1 to 4

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

Started

Container started

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

Started

Container started

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

Created

Container created

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

Created

Container created

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

Started

Container started

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

Created

Container created

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

Unhealthy

Readiness probe failed: Get "http://10.132.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-b-b7bf55-778fbdd574-wxpqj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

ProbeError

Readiness probe error: Get "http://10.132.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b7bf55-67c674978c-hv7pq

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-caa7a0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-caa7a0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

Unhealthy

Startup probe failed: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

ProbeError

Startup probe error: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-5389d2-openshift-default-b866c4b4f

SuccessfulCreate

Created pod: e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

openshift-ingress

deployment-controller

e2e-api-b-5389d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-5389d2-openshift-default-b866c4b4f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-5389d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-5389d2

openshift-ingress

multus

e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 10 to 6

openshift-ingress

deployment-controller

e2e-ipp-a-4844f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-4844f7-openshift-default-758b94c69c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-4844f7-openshift-default-758b94c69c

SuccessfulCreate

Created pod: e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-4844f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-4844f7

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-xjkwp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-q8qls

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-n6px4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-84fed1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-84fed1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-5887fc4698-bsrkb

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

openshift-ingress

deployment-controller

e2e-mt-6d9258eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6d9258eb-openshift-default-7b8cd879df from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6d9258eb-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-868569b7f-t7b7z

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

Started

Container started

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

Created

Container created

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-rgpgd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

Started

Container started

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

Started

Container started

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

Created

Container created

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

Created

Container created

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4844f7: serviceaccount "payload-processing-e2e-ipp-a-4844f7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-wb5cv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4844f7-b76d8c8bb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4844f7: serviceaccount "payload-processing-e2e-ipp-a-4844f7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4844f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4844f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4844f7-b76d8c8bb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-wb5cv

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-caa7a0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-caa7a0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4844f7-b76d8c8bb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-45557
(x5)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-45557

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-45557

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-wb5cv

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

Unhealthy

Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

ProbeError

Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-45557

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-45557

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-wb5cv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-wb5cv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

ProbeError

Startup probe error: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

Unhealthy

Startup probe failed: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

ProbeError

Startup probe error: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

Unhealthy

Startup probe failed: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-5389d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-5389d2-67c9c84b9d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5389d2-67c9c84b9d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-5389d2-67c9c84b9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5389d2: serviceaccount "payload-processing-e2e-api-b-5389d2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5389d2-67c9c84b9d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-5389d2-67c9c84b9d-xk7p8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5389d2-7bcc84c775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5389d2: serviceaccount "payload-processing-e2e-api-b-5389d2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5389d2-7bcc84c775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-rm9l2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-5389d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-5389d2-7bcc84c775 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-rm9l2

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-rm9l2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-caa7a0: serviceaccount "payload-processing-e2e-ipp-a-caa7a0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-caa7a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-caa7a0-7c4d59f64 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-caa7a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-5389d2-67c9c84b9d-xk7p8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-rm9l2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-5389d2-67c9c84b9d-xk7p8

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-5389d2-67c9c84b9d-xk7p8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-5389d2-67c9c84b9d-xk7p8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-rm9l2

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-caa7a0: serviceaccount "payload-processing-e2e-ipp-a-caa7a0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 6 to 5

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

multus

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-v5xcs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-gb6sx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.068s (2.068s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp

Started

Container started

openshift-ingress

deployment-controller

e2e-mt-6d9258eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6d9258eb-openshift-default-7b8cd879df from 8 to 10

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-6d9258eb-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.749s (1.749s including waiting). Image size: 166612641 bytes.

openshift-ingress

replicaset-controller

e2e-mt-6d9258eb-openshift-default-7b8cd879df

SuccessfulCreate

(combined from similar events): Created pod: e2e-mt-6d9258eb-openshift-default-7b8cd879df-lhsgh

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-gb6sx

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-gb6sx

Started

Container started

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-gb6sx

Created

Container created

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-lhsgh

Started

Container started

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-lhsgh

Created

Container created

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-lhsgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-6d9258eb-openshift-default-7b8cd879df-lhsgh

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-gb6sx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b7bf55-openshift-default-69cf9bbfb5-8qsnr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-c92679-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c92679-openshift-default-586ff5975f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-c92679-openshift-default-586ff5975f

SuccessfulCreate

Created pod: e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c92679

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c92679

openshift-ingress

multus

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4844f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4844f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-84fed1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-84fed1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c92679-569cdb57b8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c92679-569cdb57b8-6k75b
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c92679-569cdb57b8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c92679-569cdb57b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c92679: serviceaccount "payload-processing-e2e-ipp-a-c92679" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c92679

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c92679-569cdb57b8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-rw296

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c92679

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c92679: serviceaccount "payload-processing-e2e-ipp-a-c92679" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-rw296

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-rw296

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-rw296

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c92679-569cdb57b8-6k75b

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-c92679-569cdb57b8-6k75b

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-rw296

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c92679-569cdb57b8-6k75b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c92679-569cdb57b8-6k75b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3ccdab-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-3ccdab-openshift-default-6865b8777c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3ccdab-openshift-default-6865b8777c-q8ttp

openshift-ingress

deployment-controller

e2e-worker-w0-3ccdab-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3ccdab-openshift-default-6865b8777c from 4 to 3

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9954t

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zp75

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mq42j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7sl2h

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-9784v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-vdvg9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-gb6sx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-nw4xn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-98cts

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-lhsgh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-g869q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-5da940-openshift-default-698d77c867

SuccessfulCreate

Created pod: e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5da940

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5da940

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-tp6wc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-b-5da940-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5da940-openshift-default-698d77c867 from 0 to 1

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-v8p2f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d9258eb-openshift-default-7b8cd879df-7c5gj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-c8bb87-openshift-default-7658ccf69c

SuccessfulCreate

Created pod: e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

openshift-ingress

multus

e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-c8bb87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c8bb87-openshift-default-7658ccf69c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-c8bb87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c8bb87

openshift-ingress

multus

e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

ProbeError

Readiness probe error: Get "http://10.134.0.131:15021/healthz/ready": read tcp 10.134.0.2:39778->10.134.0.131:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

Unhealthy

Readiness probe failed: Get "http://10.134.0.131:15021/healthz/ready": read tcp 10.134.0.2:39778->10.134.0.131:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5da940-59d67579bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5da940-59d67579bd-bjkq8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5da940

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5da940-657ff65d87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5da940-657ff65d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-vbg68
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5da940-59d67579bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5da940-59d67579bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5da940: serviceaccount "payload-processing-e2e-ipp-b-5da940" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5da940-657ff65d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5da940: serviceaccount "payload-processing-e2e-ipp-b-5da940" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4844f7-b76d8c8bb-45557

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5da940

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5da940-59d67579bd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4844f7-c5b7c4c75-wb5cv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5da940-59d67579bd-bjkq8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-5da940-59d67579bd-bjkq8

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-vbg68

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-vbg68

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-vbg68

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-vbg68

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5da940-59d67579bd-bjkq8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5da940-59d67579bd-bjkq8

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c8bb87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c8bb87-f46fd5847 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c8bb87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c8bb87-57c496478 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c8bb87-f46fd5847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c8bb87: serviceaccount "payload-processing-e2e-api-a-c8bb87" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c8bb87-f46fd5847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-lv5td

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-lv5td

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-lv5td

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-lv5td

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c8bb87-57c496478

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c8bb87-57c496478-pg4g6

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-lv5td

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c8bb87-57c496478

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c8bb87-57c496478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c8bb87: serviceaccount "payload-processing-e2e-api-a-c8bb87" not found

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

openshift-ingress

kubelet

payload-processing-e2e-api-a-c8bb87-57c496478-pg4g6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-bm6qt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-c8bb87-57c496478-pg4g6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c8bb87-57c496478-pg4g6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-c8bb87-57c496478-pg4g6

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 6 to 5
(x6)

openshift-ingress

kubelet

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-84fed1-5f977c9ccd-m4689

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-84fed1-6d88ff474c-9lgdr

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4844f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4844f7-6c67fc8fb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4844f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4844f7-675df756f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-vf9q9

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-m2npn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-k9cbs

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4844f7-6c67fc8fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4844f7: serviceaccount "payload-processing-e2e-ipp-a-4844f7" not found

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-dxqv5

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-gj6nm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4844f7-675df756f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4844f7: serviceaccount "payload-processing-e2e-ipp-a-4844f7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4844f7-675df756f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-2wdhk

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4844f7-6c67fc8fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-5ps22

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 10 to 5

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-2wdhk

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-5ps22

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-5ps22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-5ps22

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-2wdhk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-2wdhk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-2wdhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-5ps22

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c8bb87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c8bb87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

ProbeError

Startup probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

Unhealthy

Startup probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4844f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4844f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-3ccdab-openshift-default-6865b8777c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3ccdab-openshift-default-6865b8777c-fdvs2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3ccdab-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-3ccdab-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3ccdab-openshift-default-6865b8777c from 3 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5389d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-eaee54-openshift-default-86d7f47d55

SuccessfulCreate

Created pod: e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-eaee54

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-eaee54

openshift-ingress

deployment-controller

e2e-ipp-b-eaee54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-eaee54-openshift-default-86d7f47d55 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5389d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c92679-785c7f6bc9-rw296

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c92679-569cdb57b8-6k75b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

Unhealthy

Readiness probe failed: Get "http://10.134.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

ProbeError

Readiness probe error: Get "http://10.134.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eaee54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eaee54-769cd9f99b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eaee54: serviceaccount "payload-processing-e2e-ipp-b-eaee54" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eaee54-769cd9f99b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eaee54-769cd9f99b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eaee54: serviceaccount "payload-processing-e2e-ipp-b-eaee54" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eaee54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-rc7dj

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-rc7dj

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eaee54-769cd9f99b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eaee54-769cd9f99b-zz5dj

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaee54-769cd9f99b-zz5dj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaee54-769cd9f99b-zz5dj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-rc7dj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-rc7dj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-rc7dj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaee54-769cd9f99b-zz5dj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-eaee54-769cd9f99b-zz5dj

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5389d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5389d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5da940-59d67579bd-bjkq8

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5da940-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c92679-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5da940-657ff65d87-vbg68

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5da940-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c92679-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

Unhealthy

Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

ProbeError

Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c92679

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c92679

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c92679-d6c4dcfc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-p8vjk

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c92679-d6c4dcfc8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-f4jrq
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c92679-d6c4dcfc8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c92679: serviceaccount "payload-processing-e2e-ipp-a-c92679" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-p8vjk

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c92679: serviceaccount "payload-processing-e2e-ipp-a-c92679" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-p8vjk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-p8vjk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-p8vjk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-f4jrq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-f4jrq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-f4jrq

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-f4jrq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-73dffe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-73dffe-openshift-default-768c786b9c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-73dffe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-73dffe

openshift-ingress

multus

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-73dffe-openshift-default-768c786b9c

SuccessfulCreate

Created pod: e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c92679-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c92679-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-84fed1-openshift-default

FailedUpdateStatus

horizontalpodautoscalers.autoscaling "e2e-api-a-84fed1-openshift-default" not found

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-84fed1-openshift-default-7f78d7f9d9-mtj47

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-73dffe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-73dffe-84d65777b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-73dffe-84d65777b6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-73dffe-84d65777b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-73dffe: serviceaccount "payload-processing-e2e-api-b-73dffe" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-7qlvl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-73dffe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-7qlvl

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-73dffe-84d65777b6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-73dffe-84d65777b6-rvcg5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-73dffe: serviceaccount "payload-processing-e2e-api-b-73dffe" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-7qlvl

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-73dffe-84d65777b6-rvcg5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-7qlvl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-73dffe-84d65777b6-rvcg5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-73dffe-84d65777b6-rvcg5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-7qlvl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-73dffe-84d65777b6-rvcg5

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-648839-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-648839-openshift-default-66c78757c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-648839

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-648839

openshift-ingress

replicaset-controller

e2e-ipp-b-648839-openshift-default-66c78757c

SuccessfulCreate

Created pod: e2e-ipp-b-648839-openshift-default-66c78757c-sg68w
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5da940-9b8c97cf4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5da940-9b8c97cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5da940: serviceaccount "payload-processing-e2e-ipp-b-5da940" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5da940-cf6779f59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5da940: serviceaccount "payload-processing-e2e-ipp-b-5da940" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5da940

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5da940-9b8c97cf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5da940-9b8c97cf4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5da940-9b8c97cf4-jtlzp

openshift-ingress

multus

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5da940-cf6779f59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-vkgvm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5da940

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5da940-cf6779f59 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5da940-9b8c97cf4-jtlzp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5da940-9b8c97cf4-jtlzp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5da940-9b8c97cf4-jtlzp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-vkgvm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-5da940-9b8c97cf4-jtlzp

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-vkgvm

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-vkgvm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-vkgvm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5389d2-7bcc84c775-rm9l2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-5389d2-67c9c84b9d-xk7p8

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-648839

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-648839-d96cf595f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-648839-74684687fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-648839-74684687fd-4ks77

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-648839-d96cf595f-qcrtl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-648839-74684687fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-648839-74684687fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-648839: serviceaccount "payload-processing-e2e-ipp-b-648839" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5da940-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5da940-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-648839-d96cf595f-qcrtl

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-648839-d96cf595f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-648839-d96cf595f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-648839: serviceaccount "payload-processing-e2e-ipp-b-648839" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-648839-d96cf595f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-648839-d96cf595f-qcrtl

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-648839

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-648839-74684687fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-648839-d96cf595f-qcrtl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-648839-74684687fd-4ks77

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-648839-74684687fd-4ks77

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-648839-74684687fd-4ks77

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-648839-d96cf595f-qcrtl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-648839-74684687fd-4ks77

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c8bb87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c8bb87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-8696448cbc-rc7dj

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eaee54-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaee54-769cd9f99b-zz5dj

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eaee54-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eaee54-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eaee54-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-7r2nt

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-8f7zb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-bc7pr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z582g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eaee54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eaee54-8677d59954 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eaee54-8677d59954

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eaee54-8677d59954-z8xbl
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eaee54-8677d59954

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eaee54-8677d59954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eaee54: serviceaccount "payload-processing-e2e-ipp-b-eaee54" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eaee54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eaee54-76cd495699 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eaee54: serviceaccount "payload-processing-e2e-ipp-b-eaee54" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaee54-8677d59954-z8xbl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaee54-8677d59954-z8xbl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaee54-8677d59954-z8xbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-eaee54-8677d59954-z8xbl

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-5389d2-openshift-default-b866c4b4f-4hwkt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.035s (2.035s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-3f5339

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-3f5339

openshift-ingress

replicaset-controller

e2e-praxis-a-3f5339-openshift-default-976c686df

SuccessfulCreate

Created pod: e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

openshift-ingress

deployment-controller

e2e-praxis-a-3f5339-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3f5339-openshift-default-976c686df from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

ProbeError

Readiness probe error: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

Unhealthy

Readiness probe failed: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-648839-d96cf595f-qcrtl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-648839-74684687fd-4ks77

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8bb87-f46fd5847-lv5td

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-c8bb87-57c496478-pg4g6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-3f5339

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-3f5339-7df9788c5d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-49q2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3f5339-7df9788c5d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-3f5339-7df9788c5d-xsh59

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-3f5339

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3f5339-7df9788c5d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-3f5339-7df9788c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3f5339: serviceaccount "payload-processing-e2e-praxis-a-3f5339" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-49q2m

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-49q2m
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3f5339: serviceaccount "payload-processing-e2e-praxis-a-3f5339" not found

openshift-ingress

multus

payload-processing-e2e-praxis-a-3f5339-7df9788c5d-xsh59

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-49q2m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-49q2m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3f5339-7df9788c5d-xsh59

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3f5339-7df9788c5d-xsh59

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3f5339-7df9788c5d-xsh59

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4844f7-6c67fc8fb-5ps22

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4844f7-675df756f5-2wdhk

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-648839-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-648839

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-648839-5d876b7fc6 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-648839-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-648839

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-648839-75cf86f87f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-648839-5d876b7fc6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-648839-5d876b7fc6-kmjqz

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-fgzz4

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-648839-75cf86f87f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-fgzz4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-648839-75cf86f87f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-648839: serviceaccount "payload-processing-e2e-ipp-b-648839" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-648839-5d876b7fc6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-648839-5d876b7fc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-648839: serviceaccount "payload-processing-e2e-ipp-b-648839" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-648839-5d876b7fc6-kmjqz

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-fgzz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-fgzz4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-fgzz4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-648839-5d876b7fc6-kmjqz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-648839-5d876b7fc6-kmjqz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-648839-5d876b7fc6-kmjqz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3f5339-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3f5339-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-73dffe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-73dffe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-4844f7-openshift-default-758b94c69c-fx7sv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-648839-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-648839-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c92679-6c5f9cd8c9-p8vjk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c92679-d6c4dcfc8-f4jrq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaee54-8677d59954-z8xbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaee54-76cd495699-dfzlg

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-c92679-openshift-default-586ff5975f-m6wfs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-c8bb87-openshift-default-7658ccf69c-thg98

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-eaee54-openshift-default-86d7f47d55-h68n5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77

SuccessfulCreate

Created pod: e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

openshift-ingress

deployment-controller

e2e-praxis-b-e9b2dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-e9b2dd-openshift-default-88fc69d77 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-e9b2dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-e9b2dd

openshift-ingress

kubelet

payload-processing-e2e-api-b-73dffe-84d65777b6-rvcg5

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-73dffe-7b46dbc6ff-7qlvl

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-e9b2dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-e9b2dd-6b9b898998 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e9b2dd: serviceaccount "payload-processing-e2e-praxis-b-e9b2dd" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e9b2dd-6b9b898998

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e9b2dd: serviceaccount "payload-processing-e2e-praxis-b-e9b2dd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-lbdm6

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e9b2dd-6b9b898998

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-8qkg2

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-lbdm6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-lbdm6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-e9b2dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-lbdm6

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-6fcda5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-6fcda5

openshift-ingress

multus

payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-8qkg2

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-6fcda5-openshift-default-5584fd57c

SuccessfulCreate

Created pod: e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

openshift-ingress

deployment-controller

e2e-praxis-a-6fcda5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-6fcda5-openshift-default-5584fd57c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-8qkg2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-lbdm6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-8qkg2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-8qkg2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3f5339-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3f5339-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6fcda5-55b6765f7d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-mv258
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6fcda5: serviceaccount "payload-processing-e2e-praxis-a-6fcda5" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-ctrhm

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-ctrhm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-6fcda5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-ctrhm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6fcda5-55b6765f7d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6fcda5: serviceaccount "payload-processing-e2e-praxis-a-6fcda5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-6fcda5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-6fcda5-55b6765f7d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-mv258

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-mv258

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-ctrhm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-ctrhm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-mv258

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-mv258

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-9p68k

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-648839-75cf86f87f-fgzz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-648839-5d876b7fc6-kmjqz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-caa7a0-7c4d59f64-xkdgp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-caa7a0-75dbd6484c-xxnlj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-648839-openshift-default-66c78757c-sg68w

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-x4wlz

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

openshift-ingress

deployment-controller

e2e-praxis-a-e25f4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e25f4a-openshift-default-d4446c48f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-e25f4a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-e25f4a

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-z262d

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-b79r6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tzctd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-tzctd

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-tcnb5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-z262d

openshift-ingress

kubelet

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-48e1f1-openshift-default-695d7746df

SuccessfulCreate

Created pod: e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

openshift-ingress

kubelet

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-73dffe-openshift-default-768c786b9c-ww8r4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ipp-a-48e1f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-48e1f1-openshift-default-695d7746df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-48e1f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-48e1f1

openshift-ingress

multus

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-b79r6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-48e1f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-48e1f1-747bcf8766 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-48e1f1-747bcf8766-hv7r6

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-dfpbb

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-dfpbb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-dfpbb

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

Unhealthy

Readiness probe failed: Get "http://10.134.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-48e1f1-747bcf8766

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-48e1f1-747bcf8766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-48e1f1: serviceaccount "payload-processing-e2e-ipp-a-48e1f1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-48e1f1-747bcf8766

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-48e1f1-747bcf8766-hv7r6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-dfpbb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-48e1f1: serviceaccount "payload-processing-e2e-ipp-a-48e1f1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-dfpbb

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-48e1f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c from 0 to 1

openshift-ingress

kubelet

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

ProbeError

Readiness probe error: Get "http://10.134.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-48e1f1-747bcf8766-hv7r6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-48e1f1-747bcf8766-hv7r6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-48e1f1-747bcf8766-hv7r6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-e25f4a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-e25f4a-6dc7b89886 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-b920f1-openshift-default-6f7c86785c

SuccessfulCreate

Created pod: e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q

openshift-ingress

deployment-controller

e2e-praxis-b-b920f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b920f1-openshift-default-6f7c86785c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-e25f4a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e25f4a: serviceaccount "payload-processing-e2e-praxis-a-e25f4a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e25f4a: serviceaccount "payload-processing-e2e-praxis-a-e25f4a" not found
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b920f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b920f1
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3f5339-fd9bb57f-49q2m

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

ProbeError

Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b920f1: serviceaccount "payload-processing-e2e-praxis-b-b920f1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-g9jbk
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

Unhealthy

Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b920f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b920f1-55844597bb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b920f1-55844597bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b920f1: serviceaccount "payload-processing-e2e-praxis-b-b920f1" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3f5339-7df9788c5d-xsh59

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b920f1-55844597bb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b920f1-55844597bb-bgsl4

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b920f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b920f1-55844597bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b920f1-55844597bb-bgsl4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b920f1-55844597bb-bgsl4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-g9jbk

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-g9jbk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-g9jbk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-g9jbk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-b920f1-55844597bb-bgsl4

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b920f1-55844597bb-bgsl4

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6fcda5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6fcda5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 5 to 3

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-7zc4f

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-skqp6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e9b2dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-caa7a0-openshift-default-5479f48849-rwhk8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e9b2dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e9b2dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e9b2dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-3f5339-openshift-default-976c686df-gw75p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 5 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

openshift-ingress

deployment-controller

e2e-praxis-a-e25f4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e25f4a-openshift-default-d4446c48f from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e25f4a-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-48e1f1-747bcf8766-hv7r6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-56fdd77d6c-dfpbb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5da940-9b8c97cf4-jtlzp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5da940-cf6779f59-vkgvm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rcqpk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e9b2dd-5b947d49b7-lbdm6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e9b2dd-6b9b898998-8qkg2

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65

SuccessfulCreate

Created pod: e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-eb5531

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-eb5531
(x6)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-praxis-b-eb5531-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-eb5531-openshift-default-57bf5b5d65 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-rjwvt

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused

openshift-ingress

multus

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6fcda5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6fcda5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-3ccdab-openshift-default-6865b8777c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3ccdab-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-9v764

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-5da940-openshift-default-698d77c867-ncpdg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-3ccdab-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3ccdab-openshift-default-6865b8777c from 2 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-4093c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-4093c5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e25f4a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e25f4a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-a-4093c5-openshift-default-79d57c889c

SuccessfulCreate

Created pod: e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

openshift-ingress

deployment-controller

e2e-praxis-a-4093c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-4093c5-openshift-default-79d57c889c from 0 to 1

openshift-ingress

multus

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-48e1f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-48e1f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-48e1f1: serviceaccount "payload-processing-e2e-ipp-a-48e1f1" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-48e1f1: serviceaccount "payload-processing-e2e-ipp-a-48e1f1" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-6rkmz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-6rkmz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-4093c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4093c5-76f9565568

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-4093c5-76f9565568-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4093c5: serviceaccount "payload-processing-e2e-praxis-a-4093c5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-4093c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-4093c5-76f9565568 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-6rkmz

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4093c5: serviceaccount "payload-processing-e2e-praxis-a-4093c5" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-6rkmz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-6rkmz

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4093c5-76f9565568

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-4093c5-76f9565568-t5dcf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-8lm4q

openshift-ingress

multus

payload-processing-e2e-praxis-a-4093c5-76f9565568-t5dcf

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4093c5-76f9565568-t5dcf

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-48e1f1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-48e1f1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-8lm4q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-8lm4q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-8lm4q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4093c5-76f9565568-t5dcf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-8lm4q

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4093c5-76f9565568-t5dcf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6fcda5-55b6765f7d-mv258

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6fcda5-9658fdf75-ctrhm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-e9b2dd-openshift-default-88fc69d77-q5lfn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-a-e25f4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e25f4a-openshift-default-d4446c48f from 4 to 8

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e25f4a-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b920f1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb

Unhealthy

Readiness probe failed: dial tcp 10.134.0.170:9004: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b920f1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-eb5531

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-eb5531

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-eb5531-685c6657f6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-eb5531: serviceaccount "payload-processing-e2e-praxis-b-eb5531" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-eb5531-685c6657f6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-eb5531-685c6657f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-eb5531: serviceaccount "payload-processing-e2e-praxis-b-eb5531" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-qsggj

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-eb5531-685c6657f6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-eb5531-685c6657f6-kv7kw

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-qsggj

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-qsggj

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-qsggj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-eb5531-685c6657f6-kv7kw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-qsggj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-eb5531-685c6657f6-kv7kw

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-eb5531-685c6657f6-kv7kw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-eb5531-685c6657f6-kv7kw

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

Unhealthy

Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

ProbeError

Startup probe error: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

Unhealthy

Startup probe failed: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

ProbeError

Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-48e1f1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-48e1f1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4093c5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-praxis-a-e25f4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e25f4a-openshift-default-d4446c48f from 8 to 9

openshift-ingress

replicaset-controller

e2e-praxis-a-e25f4a-openshift-default-d4446c48f

SuccessfulCreate

Created pod: e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4093c5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e25f4a-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

multus

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-45f11c-openshift-default-749c888765

SuccessfulCreate

Created pod: e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

openshift-ingress

deployment-controller

e2e-ipp-b-45f11c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-45f11c-openshift-default-749c888765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-45f11c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-45f11c

openshift-ingress

multus

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-6fcda5-openshift-default-5584fd57c-9f46v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45f11c-88685759d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-45f11c-88685759d-hlhng
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45f11c: serviceaccount "payload-processing-e2e-ipp-b-45f11c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-45f11c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-45f11c-88685759d from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b920f1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b920f1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45f11c-88685759d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-45f11c-88685759d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45f11c: serviceaccount "payload-processing-e2e-ipp-b-45f11c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-45f11c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-s6l4w

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-s6l4w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-45f11c-88685759d-hlhng

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-s6l4w

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-s6l4w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45f11c-88685759d-hlhng

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45f11c-88685759d-hlhng

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-s6l4w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45f11c-88685759d-hlhng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-bebfd6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-bebfd6

openshift-ingress

replicaset-controller

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877

SuccessfulCreate

Created pod: e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

openshift-ingress

deployment-controller

e2e-praxis-b-bebfd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-bebfd6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-bebfd6-74db98c9b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bebfd6-74db98c9b

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-bebfd6-74db98c9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bebfd6: serviceaccount "payload-processing-e2e-praxis-b-bebfd6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bebfd6: serviceaccount "payload-processing-e2e-praxis-b-bebfd6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bebfd6-74db98c9b

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-bebfd6-74db98c9b-mchqr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-6d87b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-bebfd6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-6d87b

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-6d87b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-bebfd6-74db98c9b-mchqr

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bebfd6-74db98c9b-mchqr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bebfd6-74db98c9b-mchqr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-6d87b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-6d87b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bebfd6-74db98c9b-mchqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

Unhealthy

Readiness probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

ProbeError

Readiness probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bqj6z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b920f1-55cf8579b7-g9jbk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b920f1-55844597bb-bgsl4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-eb5531-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-eb5531-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

Unhealthy

Startup probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

ProbeError

Startup probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 6 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-g9k6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-jl9kj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 3 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

Started

Container started

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

Unhealthy

Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

ProbeError

Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

Unhealthy

Readiness probe failed: Get "http://10.132.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

ProbeError

Readiness probe error: Get "http://10.132.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4093c5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4093c5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45f11c-56dcf5b8c5-s6l4w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45f11c-88685759d-hlhng

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-eb5531-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-eb5531-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

Unhealthy

Startup probe failed: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

ProbeError

Startup probe error: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-b920f1-openshift-default-6f7c86785c-lh47p

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45f11c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45f11c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

Started

Container started

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-45f11c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-45f11c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-45f11c-667b8cfd76 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45f11c-667b8cfd76

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-45f11c-667b8cfd76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45f11c: serviceaccount "payload-processing-e2e-ipp-b-45f11c" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-45f11c-667b8cfd76-ph74p

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-jrpg6

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45f11c-667b8cfd76

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-45f11c-667b8cfd76-ph74p
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45f11c: serviceaccount "payload-processing-e2e-ipp-b-45f11c" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45f11c-667b8cfd76-ph74p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-jrpg6

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-jrpg6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-jrpg6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45f11c-667b8cfd76-ph74p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-jrpg6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45f11c-667b8cfd76-ph74p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-ncwtx

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bebfd6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bebfd6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4093c5-6dfcd5c987-8lm4q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4093c5-76f9565568-t5dcf

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45f11c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45f11c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulCreate

Created pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

Created

Container created

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

Started

Container started

openshift-ingress

multus

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

ProbeError

Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

ProbeError

Startup probe error: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

Unhealthy

Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

Unhealthy

Startup probe failed: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-4093c5-openshift-default-79d57c889c-cj7hl

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bebfd6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bebfd6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bebfd6-769cccfbf9-6d87b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bebfd6-74db98c9b-mchqr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-48e1f1-5bf98f5c6d-6rkmz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-48e1f1-dc546f967-b97lb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-48e1f1-openshift-default-695d7746df-fxx52

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-bebfd6-openshift-default-6c4dbf7877-h6f24

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45f11c-8d4c644c5-jrpg6

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45f11c-667b8cfd76-ph74p

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

ProbeError

Startup probe error: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

Unhealthy

Startup probe failed: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

ProbeError

Startup probe error: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

Unhealthy

Startup probe failed: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-45f11c-openshift-default-749c888765-rtgjv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

Unhealthy

Startup probe failed: Get "http://10.134.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

ProbeError

Startup probe error: Get "http://10.134.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6tssr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-6tssr
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e25f4a-5575b57bb7-zft7q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e25f4a-6dc7b89886-cqwcs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-praxis-a-9c1994-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-9c1994

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-9c1994

openshift-ingress

replicaset-controller

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc

SuccessfulCreate

Created pod: e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

openshift-ingress

multus

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-9c1994-6746bd85fd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-9c1994-6746bd85fd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-9c1994-6746bd85fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-9c1994: serviceaccount "payload-processing-e2e-praxis-a-9c1994" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-9c1994: serviceaccount "payload-processing-e2e-praxis-a-9c1994" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-9c1994

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-9c1994-6746bd85fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-9c1994

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9c1994-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9c1994-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

Unhealthy

Startup probe failed: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

ProbeError

Startup probe error: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-praxis-b-c3ad80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c3ad80-openshift-default-7fc847b985 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-c3ad80-openshift-default-7fc847b985

SuccessfulCreate

Created pod: e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

openshift-ingress

deployment-controller

e2e-shared-a-w2-f1b14f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887

SuccessfulCreate

Created pod: e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-f1b14f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-f1b14f

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-c3ad80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-c3ad80

openshift-ingress

multus

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulCreate

Created pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-c3ad80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-c3ad80-79c456576 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-c3ad80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c3ad80: serviceaccount "payload-processing-e2e-praxis-b-c3ad80" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c3ad80-79c456576

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-c3ad80-79c456576-c6ktq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c3ad80-79c456576

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-c3ad80-79c456576-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c3ad80: serviceaccount "payload-processing-e2e-praxis-b-c3ad80" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-6xcpk

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-6xcpk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-c3ad80-79c456576-c6ktq

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-6xcpk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-6xcpk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-f1b14f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f1b14f: serviceaccount "payload-processing-e2e-shared-a-w2-f1b14f" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c3ad80-79c456576-c6ktq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-6xcpk

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-f1b14f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c3ad80-79c456576-c6ktq

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f1b14f: serviceaccount "payload-processing-e2e-shared-a-w2-f1b14f" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c3ad80-79c456576-c6ktq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

ProbeError

Startup probe error: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

Unhealthy

Startup probe failed: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-x5qkm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-m75vc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-28ca05

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-28ca05

openshift-ingress

deployment-controller

e2e-shared-a-w4-28ca05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-28ca05-openshift-default-7567c7697c from 0 to 1

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-fqbhj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulCreate

Created pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-8n9ch

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4pcgv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-jxm7b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-dkq25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-hx2qg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-e25f4a-openshift-default-d4446c48f-4b6zv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-dpg78

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-28ca05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-28ca05: serviceaccount "payload-processing-e2e-shared-a-w4-28ca05" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-28ca05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-pjj5c
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-28ca05: serviceaccount "payload-processing-e2e-shared-a-w4-28ca05" not found
(x5)

openshift-ingress

kubelet

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-dpg78

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-dpg78

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-dpg78

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-pjj5c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-pjj5c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-dpg78

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-pjj5c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-pjj5c

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-eb5531-685c6657f6-kv7kw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-eb5531-7fb4dbcf9-qsggj

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

Created

Container created

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9c1994-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9c1994-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

ProbeError

Startup probe error: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

Unhealthy

Startup probe failed: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

Unhealthy

Startup probe failed: Get "http://10.132.0.223:15021/healthz/ready": dial tcp 10.132.0.223:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

ProbeError

Startup probe error: Get "http://10.132.0.223:15021/healthz/ready": dial tcp 10.132.0.223:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

Unhealthy

Startup probe failed: Get "http://10.132.0.223:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

ProbeError

Startup probe error: Get "http://10.132.0.223:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-eb5531-openshift-default-57bf5b5d65-bhs78

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 8 to 9

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulCreate

Created pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

Started

Container started

openshift-ingress

multus

e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

ProbeError

Readiness probe error: Get "http://10.132.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

Unhealthy

Readiness probe failed: Get "http://10.132.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

ProbeError

Startup probe error: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

Unhealthy

Startup probe failed: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w3-933195-openshift-default-77ff6d57

SuccessfulCreate

Created pod: e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

openshift-ingress

deployment-controller

e2e-shared-a-w3-933195-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-933195-openshift-default-77ff6d57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-933195

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-933195

openshift-ingress

multus

e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-gsftv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gsftv

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

ProbeError

Startup probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

Unhealthy

Startup probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-87f2e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-87f2e6

openshift-ingress

multus

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w0-87f2e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9

SuccessfulCreate

Created pod: e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-933195

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-933195-5c9ff88b66 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-933195

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-933195: serviceaccount "payload-processing-e2e-shared-a-w3-933195" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c3ad80-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c3ad80-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-933195: serviceaccount "payload-processing-e2e-shared-a-w3-933195" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f

SuccessfulCreate

Created pod: e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

openshift-ingress

deployment-controller

e2e-shared-b-w2-4fff4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-f1b14f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-4fff4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-4fff4f

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-f1b14f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-87f2e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-87f2e6: serviceaccount "payload-processing-e2e-shared-a-w0-87f2e6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

Unhealthy

Startup probe failed: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

ProbeError

Startup probe error: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-87f2e6: serviceaccount "payload-processing-e2e-shared-a-w0-87f2e6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-87f2e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-4fff4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-4fff4f-786458586b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4fff4f: serviceaccount "payload-processing-e2e-shared-b-w2-4fff4f" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-b02580

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-b02580

openshift-ingress

replicaset-controller

e2e-shared-b-w4-b02580-openshift-default-5b8db95499

SuccessfulCreate

Created pod: e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4fff4f-786458586b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-4fff4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w4-b02580-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-b02580-openshift-default-5b8db95499 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4fff4f-786458586b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-4fff4f-786458586b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4fff4f: serviceaccount "payload-processing-e2e-shared-b-w2-4fff4f" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9c1994-6746bd85fd-tmtgn

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.194:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9c1994-bbdc76fd7-zvmzg

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.193:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-b02580-8594797668

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-b02580-8594797668

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-b02580-8594797668-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-b02580: serviceaccount "payload-processing-e2e-shared-b-w4-b02580" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-b02580

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-b02580

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-b02580-8594797668 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-b02580: serviceaccount "payload-processing-e2e-shared-b-w4-b02580" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulCreate

Created pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w4-28ca05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-28ca05-openshift-default-7567c7697c from 1 to 4

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulCreate

Created pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulCreate

Created pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl

AddedInterface

Add eth0 [10.134.0.211/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

Started

Container started

openshift-ingress

multus

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

Unhealthy

Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

ProbeError

Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl

ProbeError

Startup probe error: Get "http://10.134.0.211:15021/healthz/ready": dial tcp 10.134.0.211:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl

Unhealthy

Startup probe failed: Get "http://10.134.0.211:15021/healthz/ready": dial tcp 10.134.0.211:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c3ad80-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c3ad80-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-f1b14f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-f1b14f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-9c1994-openshift-default-7d4b84b8cc-m2kcd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-bbae89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-bbae89

openshift-ingress

replicaset-controller

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc

SuccessfulCreate

Created pod: e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

openshift-ingress

multus

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-bbae89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c3ad80-79c456576-c6ktq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c3ad80-65964d85ff-6xcpk

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-4a92de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-4a92de

openshift-ingress

replicaset-controller

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9

SuccessfulCreate

Created pod: e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

openshift-ingress

deployment-controller

e2e-shared-b-w0-4a92de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

Unhealthy

Readiness probe failed: Get "http://10.132.0.229:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

ProbeError

Readiness probe error: Get "http://10.132.0.229:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulCreate

Created pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

openshift-ingress

deployment-controller

e2e-shared-a-w4-28ca05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-28ca05-openshift-default-7567c7697c from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulCreate

Created pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-4fff4f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-4fff4f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

Started

Container started

openshift-ingress

multus

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-4a92de: serviceaccount "payload-processing-e2e-shared-b-w0-4a92de" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-4a92de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-4a92de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-4a92de: serviceaccount "payload-processing-e2e-shared-b-w0-4a92de" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-bbae89: serviceaccount "payload-processing-e2e-shared-b-w3-bbae89" not found
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

ProbeError

Startup probe error: Get "http://10.134.0.206:15021/healthz/ready": dial tcp 10.134.0.206:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-bbae89: serviceaccount "payload-processing-e2e-shared-b-w3-bbae89" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-bbae89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

Unhealthy

Startup probe failed: Get "http://10.134.0.206:15021/healthz/ready": dial tcp 10.134.0.206:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-b02580-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-bbae89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-b02580-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-933195-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-933195-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

ProbeError

Startup probe error: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

Unhealthy

Startup probe failed: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-c3ad80-openshift-default-7fc847b985-hk4ww

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-87f2e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

Unhealthy

Startup probe failed: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

ProbeError

Startup probe error: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-87f2e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

ProbeError

Startup probe error: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

Unhealthy

Startup probe failed: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-explicit-a51616-openshift-default-6556fbb557

SuccessfulCreate

Created pod: e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

openshift-ingress

gateway_labeler_controller

e2e-explicit-a51616

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-a51616

openshift-ingress

deployment-controller

e2e-explicit-a51616-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-a51616-openshift-default-6556fbb557 from 0 to 1

openshift-ingress

multus

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-4fff4f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-4fff4f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-b02580-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-b02580-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-933195-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a51616-cb69f88f4

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-a51616-cb69f88f4-mwffs
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-933195-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-a51616

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-a51616-cb69f88f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a51616-8bb96fd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-a51616-8bb96fd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a51616: serviceaccount "payload-processing-e2e-explicit-a51616" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a51616-8bb96fd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-a51616-8bb96fd47-rz67x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-a51616

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-a51616-8bb96fd47 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a51616-cb69f88f4

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-a51616-cb69f88f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a51616: serviceaccount "payload-processing-e2e-explicit-a51616" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a51616-8bb96fd47-rz67x

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-explicit-a51616-8bb96fd47-rz67x

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a51616-cb69f88f4-mwffs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a51616-8bb96fd47-rz67x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-a51616-cb69f88f4-mwffs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a51616-8bb96fd47-rz67x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-a51616-cb69f88f4-mwffs

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a51616-cb69f88f4-mwffs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-87f2e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-87f2e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

ProbeError

Readiness probe error: Get "http://10.132.0.236:15021/healthz/ready": read tcp 10.132.0.2:33594->10.132.0.236:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

Unhealthy

Readiness probe failed: Get "http://10.132.0.236:15021/healthz/ready": read tcp 10.132.0.2:33594->10.132.0.236:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

Unhealthy

Startup probe failed: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

ProbeError

Startup probe error: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

ProbeError

Startup probe error: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

Unhealthy

Startup probe failed: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bbae89-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bbae89-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-4a92de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-4a92de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f

SuccessfulCreate

Created pod: e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

Started

Container started

openshift-ingress

multus

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bbae89-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-bbae89-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

Unhealthy

Startup probe failed: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

ProbeError

Startup probe error: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

ProbeError

Readiness probe error: Get "http://10.132.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

Unhealthy

Readiness probe failed: Get "http://10.132.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-4a92de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-4a92de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

Unhealthy

Startup probe failed: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

ProbeError

Startup probe error: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-a51616-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-a51616-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a51616-8bb96fd47-rz67x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-a51616-cb69f88f4-mwffs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-a51616-openshift-default-6556fbb557-2v8f2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-afbe5f-openshift-default-666c6686c5

SuccessfulCreate

Created pod: e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

openshift-ingress

gateway_labeler_controller

e2e-noten-afbe5f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-afbe5f

openshift-ingress

deployment-controller

e2e-noten-afbe5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-afbe5f-openshift-default-666c6686c5 from 0 to 1

openshift-ingress

multus

e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

Created

Container created

openshift-ingress

kubelet

e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-dvvr7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-qvr9l

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-jhtz2

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-69wm7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-afbe5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-afbe5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-afbe5f-openshift-default-666c6686c5-82b59

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 3 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-fqn85
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fqn85

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-z2zxn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9n7dr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-72x6r

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-sm97j

opendatahub

multus

test-curl-7374-755b13

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7374-755b13

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-jh8wc

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-t6949

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-ltfk9

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-4qjgx

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7377-fc21b2

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7377-fc21b2

Created

Container created

opendatahub

kubelet

test-curl-7374-755b13

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 10.504s (10.504s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7374-755b13

Started

Container started

opendatahub

kubelet

test-curl-7377-fc21b2

Started

Container started

opendatahub

kubelet

test-curl-7374-755b13

Created

Container created

opendatahub

kubelet

test-curl-7377-fc21b2

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7377-705b28

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7377-705b28

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7377-fc21b2

Killing

Stopping container test-curl-7377-fc21b2

opendatahub

kubelet

test-curl-7377-705b28

Started

Container started

opendatahub

kubelet

test-curl-7377-705b28

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-a-w4-28ca05-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-28ca05-openshift-default-7567c7697c from 6 to 5

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-znbdr

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7374-755b13

Killing

Stopping container test-curl-7374-755b13

openshift-ingress

replicaset-controller

e2e-extmod-a-f8f132-openshift-default-664fdd74c7

SuccessfulCreate

Created pod: e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

openshift-ingress

deployment-controller

e2e-extmod-a-f8f132-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-f8f132-openshift-default-664fdd74c7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-f8f132

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-f8f132

opendatahub

kubelet

test-curl-7377-705b28

Killing

Stopping container test-curl-7377-705b28

opendatahub

multus

test-curl-7377-d48c42

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7377-d48c42

Created

Container created

opendatahub

kubelet

test-curl-7377-d48c42

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7377-d48c42

Started

Container started

openshift-ingress

multus

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7377-e41327

Created

Container created

opendatahub

kubelet

test-curl-7377-d48c42

Killing

Stopping container test-curl-7377-d48c42

opendatahub

kubelet

test-curl-7377-e41327

Started

Container started

opendatahub

kubelet

test-curl-7377-e41327

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7377-e41327

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes

opendatahub

multus

test-curl-7377-c7fbc8

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-f8f132: serviceaccount "payload-processing-e2e-extmod-a-f8f132" not found

opendatahub

kubelet

test-curl-7377-c7fbc8

Started

Container started

opendatahub

kubelet

test-curl-7377-c7fbc8

Created

Container created

opendatahub

kubelet

test-curl-7377-c7fbc8

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7377-e41327

Killing

Stopping container test-curl-7377-e41327
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-f8f132: serviceaccount "payload-processing-e2e-extmod-a-f8f132" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-f8f132

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-f8f132

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc

Created

Container created

opendatahub

kubelet

test-curl-7377-c7fbc8

Killing

Stopping container test-curl-7377-c7fbc8

openshift-ingress

deployment-controller

e2e-extmod-a-4f7443-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-4f7443-openshift-default-56c5cd574f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-4f7443

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-4f7443

openshift-ingress

replicaset-controller

e2e-extmod-a-4f7443-openshift-default-56c5cd574f

SuccessfulCreate

Created pod: e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

openshift-ingress

multus

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

AddedInterface

Add eth0 [10.132.1.2/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-4f7443-f94dccdc6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-4f7443-f94dccdc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-4f7443: serviceaccount "payload-processing-e2e-extmod-a-4f7443" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-4f7443

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-4f7443: serviceaccount "payload-processing-e2e-extmod-a-4f7443" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5

AddedInterface

Add eth0 [10.132.1.4/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-4f7443-f94dccdc6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-4f7443

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-4f7443-f94dccdc6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf

AddedInterface

Add eth0 [10.132.1.5/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-rv92f

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-mzfw6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-sb242

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7zphd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f8f132-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f8f132-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

Unhealthy

Startup probe failed: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

ProbeError

Startup probe error: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-dh8bg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-extmod-b-2bc4e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2bc4e2-openshift-default-75d485bdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf

SuccessfulCreate

Created pod: e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2bc4e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2bc4e2

openshift-ingress

multus

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-737f64-openshift-default-6ddddc9965

SuccessfulCreate

Created pod: e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-737f64

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-737f64

openshift-ingress

deployment-controller

e2e-extmod-a-737f64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-737f64-openshift-default-6ddddc9965 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-737f64-fc5944d86

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-737f64-fc5944d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-737f64: serviceaccount "payload-processing-e2e-extmod-a-737f64" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-737f64

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-737f64-fc5944d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-737f64: serviceaccount "payload-processing-e2e-extmod-a-737f64" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-737f64

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-737f64-fc5944d86-msl4c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-737f64-fc5944d86

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-737f64-fc5944d86-msl4c

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-737f64-fc5944d86-msl4c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-737f64-fc5944d86-msl4c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-737f64-fc5944d86-msl4c

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2bc4e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2bc4e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2bc4e2: serviceaccount "payload-processing-e2e-extmod-b-2bc4e2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2bc4e2: serviceaccount "payload-processing-e2e-extmod-b-2bc4e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7380-ca6130

Started

Container started

opendatahub

kubelet

test-curl-7380-ca6130

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx

Created

Container created

opendatahub

multus

test-curl-7380-ca6130

AddedInterface

Add eth0 [10.132.1.12/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7380-ca6130

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-e43a66-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e43a66-openshift-default-7d59bc8989 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-e43a66-openshift-default-7d59bc8989

SuccessfulDelete

Deleted pod: e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e43a66-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f8f132-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f8f132-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-r2h5c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-autores-3e23ec-openshift-default-5dcb78b869

SuccessfulCreate

Created pod: e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

openshift-ingress

multus

e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-3e23ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-3e23ec-openshift-default-5dcb78b869 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-3e23ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-3e23ec

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

Unhealthy

Readiness probe failed: Get "http://10.132.1.2:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

ProbeError

Readiness probe error: Get "http://10.132.1.2:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-rfh77

openshift-ingress

deployment-controller

payload-processing-e2e-autores-3e23ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-3e23ec-695bdf4db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3e23ec: serviceaccount "payload-processing-e2e-autores-3e23ec" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3e23ec-695bdf4db

FailedCreate

Error creating: pods "payload-processing-e2e-autores-3e23ec-695bdf4db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3e23ec: serviceaccount "payload-processing-e2e-autores-3e23ec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-3e23ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3e23ec-695bdf4db

SuccessfulCreate

Created pod: payload-processing-e2e-autores-3e23ec-695bdf4db-2g5c6

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-rfh77

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-rfh77

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-rfh77

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-rfh77

Created

Container created

openshift-ingress

multus

payload-processing-e2e-autores-3e23ec-695bdf4db-2g5c6

AddedInterface

Add eth0 [10.132.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-3e23ec-695bdf4db-2g5c6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-3e23ec-695bdf4db-2g5c6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-3e23ec-695bdf4db-2g5c6

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

Unhealthy

Startup probe failed: Get "http://10.132.1.2:15021/healthz/ready": dial tcp 10.132.1.2:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

ProbeError

Startup probe error: Get "http://10.132.1.2:15021/healthz/ready": dial tcp 10.132.1.2:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-hn7bx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4f7443-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4f7443-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-846099-openshift-default-66cbbc5485

SuccessfulCreate

Created pod: e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

openshift-ingress

multus

e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

AddedInterface

Add eth0 [10.132.1.14/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-846099

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-846099

openshift-ingress

deployment-controller

e2e-extmod-b-846099-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-846099-openshift-default-66cbbc5485 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-28ca05-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-28ca05-openshift-default-7567c7697c from 5 to 4

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-g7q5g
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-846099: serviceaccount "payload-processing-e2e-extmod-b-846099" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-846099-56bff4c798

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-846099

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-846099

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-846099-56bff4c798 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-846099-56bff4c798

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-846099-56bff4c798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-846099: serviceaccount "payload-processing-e2e-extmod-b-846099" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-9zbmj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4f7443-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4f7443-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2bc4e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2bc4e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7380-ca6130

Killing

Stopping container test-curl-7380-ca6130
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

ProbeError

Startup probe error: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

Unhealthy

Startup probe failed: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-737f64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-737f64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

ProbeError

Startup probe error: Get "http://10.132.1.10:15021/healthz/ready": dial tcp 10.132.1.10:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

Unhealthy

Startup probe failed: Get "http://10.132.1.10:15021/healthz/ready": dial tcp 10.132.1.10:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f

SuccessfulCreate

Created pod: e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

openshift-ingress

deployment-controller

e2e-extmod-b-7b8a9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-7b8a9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-7b8a9d

openshift-ingress

multus

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-7b8a9d: serviceaccount "payload-processing-e2e-extmod-b-7b8a9d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-7b8a9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-7b8a9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-q4r4z
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-7b8a9d: serviceaccount "payload-processing-e2e-extmod-b-7b8a9d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-q4r4z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-mhqgv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-q4r4z

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-q4r4z

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-mhqgv

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-mhqgv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-q4r4z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-mhqgv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-mhqgv

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2bc4e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2bc4e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-3e23ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-3e23ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-737f64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-737f64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-3e23ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-3e23ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c

SuccessfulCreate

Created pod: e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

openshift-ingress

deployment-controller

e2e-extmod-a-59b8a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-59b8a9-openshift-default-cb4954c7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-59b8a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-59b8a9

openshift-ingress

multus

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

AddedInterface

Add eth0 [10.132.1.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-59b8a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-59b8a9-7845df69c6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-59b8a9-7845df69c6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-59b8a9-7845df69c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-59b8a9: serviceaccount "payload-processing-e2e-extmod-a-59b8a9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-59b8a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-59b8a9-7845df69c6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-59b8a9: serviceaccount "payload-processing-e2e-extmod-a-59b8a9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m

AddedInterface

Add eth0 [10.134.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

Unhealthy

Startup probe failed: Get "http://10.132.1.14:15021/healthz/ready": dial tcp 10.132.1.14:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

ProbeError

Startup probe error: Get "http://10.132.1.14:15021/healthz/ready": dial tcp 10.132.1.14:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-846099-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-846099-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-pq965

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x6)

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-89c8g

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 3 to 2

openshift-ingress

kubelet

payload-processing-e2e-autores-3e23ec-695bdf4db-2g5c6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3e23ec-7b4bbd9595-rfh77

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-24fnd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

ProbeError

Readiness probe error: Get "http://10.132.1.18:15021/healthz/ready": read tcp 10.132.0.2:48156->10.132.1.18:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

Unhealthy

Readiness probe failed: Get "http://10.132.1.18:15021/healthz/ready": read tcp 10.132.0.2:48156->10.132.1.18:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-846099-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-846099-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

ProbeError

Startup probe error: Get "http://10.132.1.18:15021/healthz/ready": dial tcp 10.132.1.18:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

Unhealthy

Startup probe failed: Get "http://10.132.1.18:15021/healthz/ready": dial tcp 10.132.1.18:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7b8a9d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7b8a9d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-a-w4-28ca05-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-28ca05-openshift-default-7567c7697c from 4 to 3

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-spb7f

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-autores-3e23ec-openshift-default-5dcb78b869-5ww28

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7b8a9d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7b8a9d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf

SuccessfulCreate

Created pod: e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-67e819

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-67e819

openshift-ingress

deployment-controller

e2e-extmod-a-67e819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf from 0 to 1

openshift-ingress

multus

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

AddedInterface

Add eth0 [10.132.1.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-67e819

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-67e819

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-67e819: serviceaccount "payload-processing-e2e-extmod-a-67e819" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-67e819: serviceaccount "payload-processing-e2e-extmod-a-67e819" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc

AddedInterface

Add eth0 [10.132.1.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477

SuccessfulCreate

Created pod: e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-b15ec3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-b15ec3

openshift-ingress

deployment-controller

e2e-extmod-b-b15ec3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b15ec3-openshift-default-8c8c5d477 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

AddedInterface

Add eth0 [10.132.1.42/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

Unhealthy

Startup probe failed: Get "http://10.132.1.19:15021/healthz/ready": dial tcp 10.132.1.19:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

ProbeError

Startup probe error: Get "http://10.132.1.19:15021/healthz/ready": dial tcp 10.132.1.19:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-b15ec3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b15ec3: serviceaccount "payload-processing-e2e-extmod-b-b15ec3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b15ec3: serviceaccount "payload-processing-e2e-extmod-b-b15ec3" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn

AddedInterface

Add eth0 [10.134.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-b15ec3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87 from 0 to 1
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-59b8a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-59b8a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 3 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-mw8fw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

ProbeError

Startup probe error: Get "http://10.132.1.39:15021/healthz/ready": dial tcp 10.132.1.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

Unhealthy

Startup probe failed: Get "http://10.132.1.39:15021/healthz/ready": dial tcp 10.132.1.39:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-bae155-openshift-default-6c7cd54585

SuccessfulCreate

Created pod: e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-bae155

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-bae155

openshift-ingress

deployment-controller

e2e-extmod-b-bae155-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-bae155-openshift-default-6c7cd54585 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

AddedInterface

Add eth0 [10.132.1.45/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b15ec3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b15ec3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bae155-56867f4547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-bae155-56867f4547-67cxs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-bae155

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-bae155-56867f4547 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-bae155

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-bae155-57bd48f8d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bae155-57bd48f8d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-bae155-57bd48f8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bae155: serviceaccount "payload-processing-e2e-extmod-b-bae155" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bae155-56867f4547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-bae155-56867f4547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bae155: serviceaccount "payload-processing-e2e-extmod-b-bae155" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bae155-57bd48f8d-hrc7w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bae155-57bd48f8d-hrc7w

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bae155-57bd48f8d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-bae155-57bd48f8d-hrc7w

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-bae155-56867f4547-67cxs

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bae155-56867f4547-67cxs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bae155-56867f4547-67cxs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bae155-57bd48f8d-hrc7w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-bae155-57bd48f8d-hrc7w

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bae155-56867f4547-67cxs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-67e819-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-67e819-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

ProbeError

Startup probe error: Get "http://10.132.1.42:15021/healthz/ready": dial tcp 10.132.1.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

Unhealthy

Startup probe failed: Get "http://10.132.1.42:15021/healthz/ready": dial tcp 10.132.1.42:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bae155-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bae155-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b15ec3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b15ec3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-737f64-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-737f64-openshift-default-6ddddc9965

SuccessfulCreate

Created pod: e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

openshift-ingress

deployment-controller

e2e-extmod-a-737f64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-737f64-openshift-default-6ddddc9965 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f8f132-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-f8f132-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-f8f132-openshift-default-664fdd74c7 from 1 to 2

openshift-ingress

multus

e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

AddedInterface

Add eth0 [10.134.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-f8f132-openshift-default-664fdd74c7

SuccessfulCreate

Created pod: e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

AddedInterface

Add eth0 [10.134.0.237/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

Unhealthy

Startup probe failed: Get "http://10.134.0.236:15021/healthz/ready": dial tcp 10.134.0.236:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

ProbeError

Startup probe error: Get "http://10.134.0.236:15021/healthz/ready": dial tcp 10.134.0.236:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

Unhealthy

Startup probe failed: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

ProbeError

Startup probe error: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

ProbeError

Startup probe error: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

Unhealthy

Startup probe failed: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7b8a9d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bae155-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f

SuccessfulCreate

Created pod: e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

openshift-ingress

deployment-controller

e2e-extmod-b-7b8a9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f from 1 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bae155-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

Unhealthy

Startup probe failed: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

ProbeError

Startup probe error: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7d6cb769d7 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7d6cb769d7

FailedCreate

Error creating: pods "payload-processing-external-model-7d6cb769d7-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-7d6cb769d7

SuccessfulCreate

Created pod: payload-processing-external-model-7d6cb769d7-w5fnm

models-as-a-service

kubelet

payload-processing-external-model-7d6cb769d7-w5fnm

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7d6cb769d7-w5fnm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7d6cb769d7-w5fnm

AddedInterface

Add eth0 [10.134.0.238/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7d6cb769d7-w5fnm

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-975fcdbd8

SuccessfulCreate

Created pod: payload-processing-external-model-975fcdbd8-xblrk

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-975fcdbd8 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-975fcdbd8-xblrk

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-975fcdbd8-xblrk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-975fcdbd8-xblrk

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-975fcdbd8-xblrk

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7d6cb769d7 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-7d6cb769d7-w5fnm

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7d6cb769d7

SuccessfulDelete

Deleted pod: payload-processing-external-model-7d6cb769d7-w5fnm

openshift-ingress

replicaset-controller

e2e-extmod-a-4f7443-openshift-default-56c5cd574f

SuccessfulCreate

Created pod: e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

openshift-ingress

multus

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4f7443-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-4f7443-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-4f7443-openshift-default-56c5cd574f from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

ProbeError

Startup probe error: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

Unhealthy

Startup probe failed: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-66bb89db4d from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-66bb89db4d

SuccessfulCreate

Created pod: payload-processing-external-model-66bb89db4d-xrxfp

models-as-a-service

multus

payload-processing-external-model-66bb89db4d-xrxfp

AddedInterface

Add eth0 [10.132.1.62/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-66bb89db4d-xrxfp

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-66bb89db4d-xrxfp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-66bb89db4d-xrxfp

Created

Container created

models-as-a-service

endpoint-controller

payload-processing-external-model

FailedToUpdateEndpoint

Failed to update endpoint models-as-a-service/payload-processing-external-model: Operation cannot be fulfilled on endpoints "payload-processing-external-model": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/models-as-a-service/payload-processing-external-model, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d9dfe941-5756-4986-9ffc-2b47c30d4e81, UID in object meta:

models-as-a-service

kubelet

payload-processing-external-model-66bb89db4d-xrxfp

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-external-model-dockercfg-qtlnm); attempting to pull the image may not succeed.

models-as-a-service

kubelet

payload-processing-external-model-975fcdbd8-xblrk

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-66bb89db4d-xrxfp

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-c985fc668 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-c985fc668

FailedCreate

Error creating: pods "payload-processing-external-model-c985fc668-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found
(x2)

models-as-a-service

kubelet

payload-processing-external-model-66bb89db4d-xrxfp

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-external-model-plugins" not found

models-as-a-service

kubelet

payload-processing-external-model-c985fc668-s84bg

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-c985fc668-s84bg

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-c985fc668-s84bg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-c985fc668-s84bg

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-c985fc668

SuccessfulCreate

Created pod: payload-processing-external-model-c985fc668-s84bg
(x4)

models-as-a-service

kubelet

payload-processing-external-model-66bb89db4d-xrxfp

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-5c638a89dd61" not found

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-7kff2
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 2 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

AddedInterface

Add eth0 [10.132.1.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

AddedInterface

Add eth0 [10.134.0.240/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-c985fc668-s84bg

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

ProbeError

Startup probe error: Get "http://10.134.0.240:15021/healthz/ready": dial tcp 10.134.0.240:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

Unhealthy

Startup probe failed: Get "http://10.134.0.240:15021/healthz/ready": dial tcp 10.134.0.240:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

ProbeError

Startup probe error: Get "http://10.132.1.64:15021/healthz/ready": dial tcp 10.132.1.64:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

Unhealthy

Startup probe failed: Get "http://10.132.1.64:15021/healthz/ready": dial tcp 10.132.1.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

Unhealthy

Startup probe failed: Get "http://10.134.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

ProbeError

Startup probe error: Get "http://10.134.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

ProbeError

Startup probe error: Get "http://10.132.1.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

Unhealthy

Startup probe failed: Get "http://10.132.1.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 4 to 7

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

AddedInterface

Add eth0 [10.132.1.68/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

AddedInterface

Add eth0 [10.134.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-4a92de-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9

SuccessfulCreate

Created pod: e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

openshift-ingress

deployment-controller

e2e-shared-b-w0-4a92de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9 from 1 to 2

openshift-ingress

multus

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

AddedInterface

Add eth0 [10.132.1.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

Unhealthy

Startup probe failed: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

ProbeError

Startup probe error: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

Unhealthy

Startup probe failed: Get "http://10.132.1.68:15021/healthz/ready": dial tcp 10.132.1.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

Unhealthy

Startup probe failed: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

ProbeError

Startup probe error: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

ProbeError

Startup probe error: Get "http://10.132.1.68:15021/healthz/ready": dial tcp 10.132.1.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

Unhealthy

Startup probe failed: Get "http://10.132.1.69:15021/healthz/ready": dial tcp 10.132.1.69:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-a-737f64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-737f64-openshift-default-6ddddc9965 from 2 to 3
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

Unhealthy

Startup probe failed: Get "http://10.132.1.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-extmod-a-737f64-openshift-default-6ddddc9965

SuccessfulCreate

Created pod: e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

ProbeError

Startup probe error: Get "http://10.132.1.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

ProbeError

Startup probe error: Get "http://10.132.1.69:15021/healthz/ready": dial tcp 10.132.1.69:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-737f64-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

Unhealthy

Startup probe failed: Get "http://10.134.0.242:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

Started

Container started
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

ProbeError

Startup probe error: Get "http://10.134.0.242:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a1f322

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a1f322

openshift-ingress

deployment-controller

e2e-inf-a-a1f322-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a1f322-openshift-default-64b5c455c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-a1f322-openshift-default-64b5c455c

SuccessfulCreate

Created pod: e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

openshift-ingress

multus

e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

AddedInterface

Add eth0 [10.132.1.70/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

ProbeError

Startup probe error: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

Unhealthy

Startup probe failed: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a1f322

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a1f322-66bb5647c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a1f322: serviceaccount "payload-processing-e2e-inf-a-a1f322" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a1f322-66bb5647c8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a1f322-66bb5647c8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a1f322-66bb5647c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a1f322: serviceaccount "payload-processing-e2e-inf-a-a1f322" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a1f322

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a1f322-78f78948cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-a-5cf206

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-5cf206

openshift-ingress

deployment-controller

e2e-inf-a-5cf206-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5cf206-openshift-default-959b49fcf from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-5cf206-openshift-default-959b49fcf

SuccessfulCreate

Created pod: e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

openshift-ingress

multus

e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5cf206-56c6bdf6fb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-xqd8z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-5cf206

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5cf206: serviceaccount "payload-processing-e2e-inf-a-5cf206" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-5cf206

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-5cf206-56c6bdf6fb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5cf206-56c6bdf6fb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5cf206: serviceaccount "payload-processing-e2e-inf-a-5cf206" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-xqd8z

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-xqd8z

AddedInterface

Add eth0 [10.132.1.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-xqd8z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-xqd8z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 7 to 9
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2924z

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-2924z

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2924z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2924z

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

AddedInterface

Add eth0 [10.132.1.73/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2924z

ProbeError

Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2924z

Unhealthy

Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

Unhealthy

Startup probe failed: Get "http://10.132.1.73:15021/healthz/ready": dial tcp 10.132.1.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

ProbeError

Startup probe error: Get "http://10.132.1.73:15021/healthz/ready": dial tcp 10.132.1.73:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5cf206-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5cf206-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-b-9b2407-openshift-default-5499469645

SuccessfulCreate

Created pod: e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

openshift-ingress

deployment-controller

e2e-inf-b-9b2407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9b2407-openshift-default-5499469645 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9b2407

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9b2407

openshift-ingress

multus

e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

AddedInterface

Add eth0 [10.132.1.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9b2407

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9b2407: serviceaccount "payload-processing-e2e-inf-b-9b2407" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9b2407-877899c8b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9b2407-877899c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9b2407: serviceaccount "payload-processing-e2e-inf-b-9b2407" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9b2407

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9b2407-877899c8b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9b2407-877899c8b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

ProbeError

Startup probe error: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

Unhealthy

Startup probe failed: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

ProbeError

Startup probe error: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

Unhealthy

Startup probe failed: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-9d71fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9d71fa-openshift-default-7569b955d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulCreate

Created pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9d71fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9d71fa

openshift-ingress

multus

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

AddedInterface

Add eth0 [10.132.1.77/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-8677757f86 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-8677757f86

FailedCreate

Error creating: pods "payload-processing-external-model-8677757f86-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-8677757f86

SuccessfulCreate

Created pod: payload-processing-external-model-8677757f86-6cj5s

models-as-a-service

kubelet

payload-processing-external-model-8677757f86-6cj5s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-8677757f86-6cj5s

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-8677757f86-6cj5s

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-8677757f86-6cj5s

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9d71fa-7b546b4f74

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9d71fa-7b546b4f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9d71fa: serviceaccount "payload-processing-e2e-inf-b-9d71fa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9d71fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9d71fa: serviceaccount "payload-processing-e2e-inf-b-9d71fa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9d71fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9d71fa-7b546b4f74 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-9d71fa-7b546b4f74-lhg2c

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

ProbeError

Readiness probe error: Get "http://10.132.1.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9d71fa-7b546b4f74-lhg2c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9d71fa-7b546b4f74-lhg2c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9d71fa-7b546b4f74-lhg2c

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9d71fa-7b546b4f74

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9d71fa-7b546b4f74-lhg2c

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-mnfsj

Unhealthy

Readiness probe failed: Get "http://10.132.1.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-8677757f86-6cj5s

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-8677757f86 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-8677757f86

FailedCreate

Error creating: pods "payload-processing-external-model-8677757f86-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-8677757f86

SuccessfulCreate

Created pod: payload-processing-external-model-8677757f86-88dkv

models-as-a-service

kubelet

payload-processing-external-model-8677757f86-88dkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-8677757f86-88dkv

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-8677757f86-88dkv

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-8677757f86-88dkv

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a1f322-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a1f322-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

kubelet

payload-processing-external-model-8677757f86-88dkv

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-inf-a-ae3538-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ae3538-openshift-default-84f8bb6f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ae3538

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ae3538

openshift-ingress

replicaset-controller

e2e-inf-a-ae3538-openshift-default-84f8bb6f

SuccessfulCreate

Created pod: e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5cf206-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5cf206-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864

AddedInterface

Add eth0 [10.132.1.78/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2924z

Unhealthy

Readiness probe failed: Get "http://10.133.0.150:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2924z

ProbeError

Readiness probe error: Get "http://10.133.0.150:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ae3538: serviceaccount "payload-processing-e2e-inf-a-ae3538" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ae3538

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ae3538-6595bffc47 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ae3538

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ae3538-6c6b77b5fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ae3538: serviceaccount "payload-processing-e2e-inf-a-ae3538" not found

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

AddedInterface

Add eth0 [10.134.0.249/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 9 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc

AddedInterface

Add eth0 [10.134.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9d71fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9d71fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae3538-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae3538-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

ProbeError

Startup probe error: Get "http://10.134.0.249:15021/healthz/ready": dial tcp 10.134.0.249:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

Unhealthy

Startup probe failed: Get "http://10.134.0.249:15021/healthz/ready": dial tcp 10.134.0.249:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9b2407-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9b2407-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

Unhealthy

Startup probe failed: Get "http://10.132.1.76:15021/healthz/ready": dial tcp 10.132.1.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

ProbeError

Startup probe error: Get "http://10.132.1.76:15021/healthz/ready": dial tcp 10.132.1.76:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9b2407-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9b2407-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-h4nph

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-h4nph

Pulled

Container image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-h4nph

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

openshift-ingress

deployment-controller

e2e-inf-b-9d71fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9d71fa-openshift-default-7569b955d9 from 1 to 4

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

AddedInterface

Add eth0 [10.134.0.251/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulCreate

Created pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulCreate

Created pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9d71fa-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulCreate

Created pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

AddedInterface

Add eth0 [10.132.1.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

Unhealthy

Readiness probe failed: Get "http://10.132.1.77:15021/healthz/ready": dial tcp 10.132.1.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

ProbeError

Readiness probe error: Get "http://10.132.1.77:15021/healthz/ready": dial tcp 10.132.1.77:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

Unhealthy

Startup probe failed: Get "http://10.134.0.251:15021/healthz/ready": dial tcp 10.134.0.251:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

ProbeError

Startup probe error: Get "http://10.134.0.251:15021/healthz/ready": dial tcp 10.134.0.251:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

ProbeError

Startup probe error: Get "http://10.132.1.80:15021/healthz/ready": dial tcp 10.132.1.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

Unhealthy

Startup probe failed: Get "http://10.132.1.80:15021/healthz/ready": dial tcp 10.132.1.80:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864

ProbeError

Startup probe error: Get "http://10.132.1.78:15021/healthz/ready": dial tcp 10.132.1.78:15021: connect: connection refused body:
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors
(x7)

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864

Unhealthy

Startup probe failed: Get "http://10.132.1.78:15021/healthz/ready": dial tcp 10.132.1.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

Unhealthy

Startup probe failed: Get "http://10.132.1.77:15021/healthz/ready": dial tcp 10.132.1.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

ProbeError

Startup probe error: Get "http://10.132.1.77:15021/healthz/ready": dial tcp 10.132.1.77:15021: connect: connection refused body:

kuadrant-system

authorino-operator-7b7bb4bc77-h4nph_2c9d4205-7d5f-429a-b5fa-81b5de8f3a5f

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-h4nph_2c9d4205-7d5f-429a-b5fa-81b5de8f3a5f became leader

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9d71fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9d71fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-0ecae0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-0ecae0

openshift-ingress

deployment-controller

e2e-inf-b-0ecae0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-0ecae0-openshift-default-dcc48f8b5 from 0 to 1

openshift-ingress

multus

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5

SuccessfulCreate

Created pod: e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

openshift-ingress

deployment-controller

e2e-inf-b-9d71fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9d71fa-openshift-default-7569b955d9 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9d71fa-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulCreate

Created pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulCreate

Created pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulCreate

Created pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulCreate

Created pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

Started

Container started

openshift-ingress

multus

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

AddedInterface

Add eth0 [10.134.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

AddedInterface

Add eth0 [10.134.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

Created

Container created

openshift-ingress

multus

e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

AddedInterface

Add eth0 [10.132.1.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-0ecae0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-0ecae0-7657485d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0ecae0: serviceaccount "payload-processing-e2e-inf-b-0ecae0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-0ecae0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-0ecae0-69fb4b6c94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0ecae0: serviceaccount "payload-processing-e2e-inf-b-0ecae0" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae3538-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g

AddedInterface

Add eth0 [10.132.1.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae3538-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

Unhealthy

Startup probe failed: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

ProbeError

Startup probe error: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

ProbeError

Startup probe error: Get "http://10.134.0.252:15021/healthz/ready": dial tcp 10.134.0.252:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

Unhealthy

Startup probe failed: Get "http://10.132.1.84:15021/healthz/ready": dial tcp 10.132.1.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

Unhealthy

Startup probe failed: Get "http://10.134.0.253:15021/healthz/ready": dial tcp 10.134.0.253:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

ProbeError

Startup probe error: Get "http://10.132.1.84:15021/healthz/ready": dial tcp 10.132.1.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

ProbeError

Startup probe error: Get "http://10.134.0.253:15021/healthz/ready": dial tcp 10.134.0.253:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

Unhealthy

Startup probe failed: Get "http://10.134.0.252:15021/healthz/ready": dial tcp 10.134.0.252:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-0ecae0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-0ecae0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-a-a1f322-openshift-default-64b5c455c

SuccessfulCreate

Created pod: e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

openshift-ingress

deployment-controller

e2e-inf-a-a1f322-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a1f322-openshift-default-64b5c455c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a1f322-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

AddedInterface

Add eth0 [10.134.0.254/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

ProbeError

Startup probe error: Get "http://10.134.0.254:15021/healthz/ready": dial tcp 10.134.0.254:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

Unhealthy

Startup probe failed: Get "http://10.134.0.254:15021/healthz/ready": dial tcp 10.134.0.254:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-0190d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-0190d8-openshift-default-7b7b476b99 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-0190d8-openshift-default-7b7b476b99

SuccessfulCreate

Created pod: e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

openshift-ingress

gateway_labeler_controller

e2e-inf-a-0190d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-0190d8

openshift-ingress

multus

e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

AddedInterface

Add eth0 [10.132.1.94/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0190d8-7fc6795d84

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-0190d8-7fc6795d84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0190d8: serviceaccount "payload-processing-e2e-inf-a-0190d8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-0190d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-0190d8-7fc6795d84 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0190d8-7777999979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-0190d8-7777999979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0190d8: serviceaccount "payload-processing-e2e-inf-a-0190d8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0190d8-7777999979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0190d8-7fc6795d84

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-0190d8-7fc6795d84-mc66q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-0190d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-0190d8-7777999979 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0190d8-7fc6795d84-mc66q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0190d8-7fc6795d84-mc66q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0190d8-7fc6795d84-mc66q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-0190d8-7fc6795d84-mc66q

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

Unhealthy

Readiness probe failed: Get "http://10.133.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

ProbeError

Readiness probe error: Get "http://10.133.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

Started

Container started

openshift-ingress

deployment-controller

e2e-inf-a-31a6e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-31a6e3-openshift-default-77c678b749 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-31a6e3-openshift-default-77c678b749

SuccessfulCreate

Created pod: e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

openshift-ingress

gateway_labeler_controller

e2e-inf-a-31a6e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-31a6e3
(x6)

openshift-ingress

kubelet

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-31a6e3: serviceaccount "payload-processing-e2e-inf-a-31a6e3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-31a6e3-5b44896d5d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-31a6e3-5b44896d5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-31a6e3: serviceaccount "payload-processing-e2e-inf-a-31a6e3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-31a6e3-5b44896d5d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-31a6e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-31a6e3-5b44896d5d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-31a6e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-31a6e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-31a6e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-0ecae0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-0ecae0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-a-a1f322-openshift-default-64b5c455c

SuccessfulCreate

Created pod: e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

openshift-ingress

deployment-controller

e2e-inf-a-a1f322-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a1f322-openshift-default-64b5c455c from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a1f322-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-ae3538-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ae3538-openshift-default-84f8bb6f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae3538-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-a-ae3538-openshift-default-84f8bb6f

SuccessfulCreate

Created pod: e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

Created

Container created

openshift-ingress

deployment-controller

e2e-inf-a-5cf206-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5cf206-openshift-default-959b49fcf from 1 to 2

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

Started

Container started

openshift-ingress

multus

e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

AddedInterface

Add eth0 [10.132.1.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-a-5cf206-openshift-default-959b49fcf

SuccessfulCreate

Created pod: e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5cf206-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

Unhealthy

Startup probe failed: Get "http://10.132.1.98:15021/healthz/ready": dial tcp 10.132.1.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

ProbeError

Startup probe error: Get "http://10.132.1.98:15021/healthz/ready": dial tcp 10.132.1.98:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

Unhealthy

Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

ProbeError

Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-dd0ff7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-dd0ff7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-dd0ff7

openshift-ingress

replicaset-controller

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c

SuccessfulCreate

Created pod: e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

openshift-ingress

multus

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

AddedInterface

Add eth0 [10.132.1.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2
(x2)

openshift-ingress

kubelet

e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-dd0ff7-5956655cf6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-dd0ff7-5956655cf6-lhbck

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-dd0ff7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-dd0ff7-5956655cf6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-dd0ff7-5956655cf6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-dd0ff7-5956655cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-dd0ff7: serviceaccount "payload-processing-e2e-inf-b-dd0ff7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-dd0ff7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-dd0ff7: serviceaccount "payload-processing-e2e-inf-b-dd0ff7" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-dd0ff7-5956655cf6-lhbck

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-dd0ff7-5956655cf6-lhbck

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-dd0ff7-5956655cf6-lhbck

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-dd0ff7-5956655cf6-lhbck

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2

AddedInterface

Add eth0 [10.132.1.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w4-28ca05-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-28ca05-openshift-default-7567c7697c from 3 to 2

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-n4mfn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-737f64-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-737f64-openshift-default-6ddddc9965

SuccessfulDelete

Deleted pod: e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

openshift-ingress

deployment-controller

e2e-extmod-a-737f64-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-737f64-openshift-default-6ddddc9965 from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0190d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-4d5lx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0190d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

Unhealthy

Startup probe failed: Get "http://10.132.1.94:15021/healthz/ready": dial tcp 10.132.1.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

ProbeError

Startup probe error: Get "http://10.132.1.94:15021/healthz/ready": dial tcp 10.132.1.94:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w0-4a92de-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-4a92de-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-kjhjl
(x6)

openshift-ingress

kubelet

e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf

SuccessfulCreate

Created pod: e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

openshift-ingress

deployment-controller

e2e-inf-b-ffea51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ffea51-openshift-default-67ff9c8fbf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ffea51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ffea51

openshift-ingress

multus

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

AddedInterface

Add eth0 [10.132.1.101/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-2fp7s

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 10 to 9

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ffea51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ffea51-55c47c4df4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ffea51-55c47c4df4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ffea51-55c47c4df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ffea51: serviceaccount "payload-processing-e2e-inf-b-ffea51" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ffea51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ffea51: serviceaccount "payload-processing-e2e-inf-b-ffea51" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-ffea51-55c47c4df4-kfzjk

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ffea51-55c47c4df4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ffea51-55c47c4df4-kfzjk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ffea51-55c47c4df4-kfzjk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ffea51-55c47c4df4-kfzjk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ffea51-55c47c4df4-kfzjk

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-31a6e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-31a6e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0190d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0190d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 9 to 7
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fp4jz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2924z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-9d71fa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-b-9d71fa-openshift-default-7569b955d9 from 8 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9d71fa-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulDelete

Deleted pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulDelete

Deleted pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-pzbkv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-ftx74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f322-78f78948cf-w8gcg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f322-66bb5647c8-gk4jk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

Unhealthy

Startup probe failed: Get "http://10.132.1.99:15021/healthz/ready": dial tcp 10.132.1.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

ProbeError

Startup probe error: Get "http://10.132.1.99:15021/healthz/ready": dial tcp 10.132.1.99:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

Unhealthy

Startup probe failed: Get "http://10.132.1.101:15021/healthz/ready": dial tcp 10.132.1.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

ProbeError

Startup probe error: Get "http://10.132.1.101:15021/healthz/ready": dial tcp 10.132.1.101:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-kv746

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-xslvm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-a1f322-openshift-default-64b5c455c-jmg4q

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ffea51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ffea51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9d71fa-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-9d71fa-openshift-default-7569b955d9

SuccessfulDelete

Deleted pod: e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-2tlb8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-9d71fa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-b-9d71fa-openshift-default-7569b955d9 from 6 to 5

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cf206-56c6bdf6fb-xqd8z

Killing

Stopping container payload-processing
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-dd0ff7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-dd0ff7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ffea51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ffea51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-5zdw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-5cf206-openshift-default-959b49fcf-zw6bh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b2407-5b7696dd87-hlfsh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b2407-877899c8b-7h2mj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-7b8a9d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f

SuccessfulDelete

Deleted pod: e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-2j2bf

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7b8a9d-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cf206-65bb5fb8c-ll7sz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9d71fa-7b546b4f74-lhg2c

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9d71fa-65b54db46c-krfm7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-9b2407-openshift-default-5499469645-bgjv9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-28ca05-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-28ca05-openshift-default-7567c7697c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-28ca05-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-79294

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-dmzrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v4rbh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-jd6jv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-v9jnt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-9d71fa-openshift-default-7569b955d9-lt8g4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-b-w2-4fff4f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-4fff4f-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-1d9b1a-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c

SuccessfulDelete

Deleted pod: e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

openshift-ingress

deployment-controller

e2e-worker-w2-1d9b1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-kgbcv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w3-4e261b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4e261b-openshift-default-6bf9798c75 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4e261b-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-4e261b-openshift-default-6bf9798c75

SuccessfulDelete

Deleted pod: e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-f4rqb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-extmod-a-737f64-openshift-default-6ddddc9965

SuccessfulDelete

Deleted pod: e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

openshift-ingress

deployment-controller

e2e-extmod-a-4f7443-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-4f7443-openshift-default-56c5cd574f from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4f7443-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-737f64-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-4f7443-openshift-default-56c5cd574f

SuccessfulDelete

Deleted pod: e2e-extmod-a-4f7443-openshift-default-56c5cd574f-vhqdc

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-5l28n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-737f64-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-737f64-openshift-default-6ddddc9965 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f8f132-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-f8f132-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-f8f132-openshift-default-664fdd74c7 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

Unhealthy

Readiness probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-f8f132-openshift-default-664fdd74c7

SuccessfulDelete

Deleted pod: e2e-extmod-a-f8f132-openshift-default-664fdd74c7-sjwbd

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-7gqbv

ProbeError

Readiness probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 7 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tjjd2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tjjd2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rjnqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tjjd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-tjjd2

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

AddedInterface

Add eth0 [10.132.1.136/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-rjnqr

AddedInterface

Add eth0 [10.134.1.7/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rjnqr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rjnqr

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tjjd2

ProbeError

Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rjnqr

ProbeError

Startup probe error: Get "http://10.134.1.7:15021/healthz/ready": dial tcp 10.134.1.7:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tjjd2

Unhealthy

Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rjnqr

Unhealthy

Startup probe failed: Get "http://10.134.1.7:15021/healthz/ready": dial tcp 10.134.1.7:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

Unhealthy

Startup probe failed: Get "http://10.132.1.136:15021/healthz/ready": dial tcp 10.132.1.136:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

ProbeError

Startup probe error: Get "http://10.132.1.136:15021/healthz/ready": dial tcp 10.132.1.136:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae3538-6595bffc47-kwstc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae3538-6c6b77b5fd-ks9xc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-sw864

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ae3538-openshift-default-84f8bb6f-2vmck

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0ecae0-7657485d7-4p99g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0ecae0-69fb4b6c94-4fjnm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-0ecae0-openshift-default-dcc48f8b5-2bnk5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0190d8-7fc6795d84-mc66q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

Unhealthy

Readiness probe failed: Get "http://10.134.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

Unhealthy

Readiness probe failed: Get "http://10.133.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

ProbeError

Readiness probe error: Get "http://10.134.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpp9t

ProbeError

Readiness probe error: Get "http://10.133.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0190d8-7777999979-z2k5f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-mt-26b7d22d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-26b7d22d-openshift-default-7d54fd76df from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-26b7d22d-openshift-default-7d54fd76df

SuccessfulCreate

Created pod: e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

openshift-ingress

gateway_labeler_controller

e2e-mt-26b7d22d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-26b7d22d

openshift-ingress

multus

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

AddedInterface

Add eth0 [10.134.1.8/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-gjl5r

AddedInterface

Add eth0 [10.134.1.9/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-gjl5r

openshift-ingress

deployment-controller

payload-processing-e2e-mt-26b7d22d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-26b7d22d-847d68b766 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-26b7d22d: serviceaccount "payload-processing-e2e-mt-26b7d22d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-26b7d22d-847d68b766

SuccessfulCreate

Created pod: payload-processing-e2e-mt-26b7d22d-847d68b766-gn5ts
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-26b7d22d-847d68b766

FailedCreate

Error creating: pods "payload-processing-e2e-mt-26b7d22d-847d68b766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-26b7d22d: serviceaccount "payload-processing-e2e-mt-26b7d22d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-26b7d22d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-gjl5r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-gjl5r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-26b7d22d-847d68b766-gn5ts

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-gjl5r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-26b7d22d-847d68b766-gn5ts

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-26b7d22d-847d68b766-gn5ts

AddedInterface

Add eth0 [10.134.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-26b7d22d-847d68b766-gn5ts

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-0190d8-openshift-default-7b7b476b99-9n45g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-31a6e3-5b44896d5d-mgpjk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-31a6e3-65bcc7f487-kkcp4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-dd0ff7-5956655cf6-lhbck

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-31a6e3-openshift-default-77c678b749-jfj7m

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dd0ff7-78b88c6c79-k89s2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ffea51-55c47c4df4-kfzjk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-849669-openshift-default-694c9cbc97

SuccessfulDelete

Deleted pod: e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

openshift-ingress

deployment-controller

e2e-worker-w4-849669-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-849669-openshift-default-694c9cbc97 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-849669-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-9265n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-dd0ff7-openshift-default-7f4f68fc6c-4xgnb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ffea51-6bd459d4c9-4qkc8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-spdnv

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-spdnv

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-ffea51-openshift-default-67ff9c8fbf-kh5nl

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

ProbeError

Startup probe error: Get "http://10.134.1.8:15021/healthz/ready": dial tcp 10.134.1.8:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

Unhealthy

Startup probe failed: Get "http://10.134.1.8:15021/healthz/ready": dial tcp 10.134.1.8:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5

SuccessfulCreate

Created pod: e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-0c1869

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-0c1869

openshift-ingress

deployment-controller

e2e-shared-a-w1-0c1869-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-26b7d22d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-26b7d22d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

AddedInterface

Add eth0 [10.134.1.12/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-0c1869: serviceaccount "payload-processing-e2e-shared-a-w1-0c1869" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-0c1869

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-0c1869: serviceaccount "payload-processing-e2e-shared-a-w1-0c1869" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-0c1869

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t

AddedInterface

Add eth0 [10.134.1.14/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82

AddedInterface

Add eth0 [10.134.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-59b8a9-5df69756b7-f2cbl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-59b8a9-7845df69c6-gtd5m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-26b7d22d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-26b7d22d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-59b8a9-openshift-default-cb4954c7c-qm9cl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b15ec3-745649cf87-896bg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b15ec3-7f6ff7f4cb-7rlkn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

Unhealthy

Startup probe failed: Get "http://10.134.1.12:15021/healthz/ready": dial tcp 10.134.1.12:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

ProbeError

Startup probe error: Get "http://10.134.1.12:15021/healthz/ready": dial tcp 10.134.1.12:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0c1869-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0c1869-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-b15ec3-openshift-default-8c8c5d477-hcrhw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-2c719a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-2c719a

openshift-ingress

replicaset-controller

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9

SuccessfulCreate

Created pod: e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

openshift-ingress

deployment-controller

e2e-shared-b-w1-2c719a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

AddedInterface

Add eth0 [10.134.1.16/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx

AddedInterface

Add eth0 [10.134.1.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-2c719a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-2c719a: serviceaccount "payload-processing-e2e-shared-b-w1-2c719a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-2c719a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-2c719a-75cc487c78 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-2c719a: serviceaccount "payload-processing-e2e-shared-b-w1-2c719a" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-26b7d22d-847d68b766-gn5ts

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt

AddedInterface

Add eth0 [10.134.1.18/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26b7d22d-56b8d4d4dc-gjl5r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-933195-openshift-default-77ff6d57-cnldn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-933195-5ddb44fb8c-b5cxn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0c1869-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-933195-5c9ff88b66-qc6lv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0c1869-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-26b7d22d-openshift-default-7d54fd76df-v76nx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-bbae89-openshift-default-79685bd9cc-vldfm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bbae89-5ff4b9d5d-kmgwg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bbae89-775b4564f5-wstsw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

deployment-controller

e2e-shared-b-w2-4fff4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-4fff4f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

AddedInterface

Add eth0 [10.134.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f

SuccessfulCreate

Created pod: e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-737f64-fc5944d86-msl4c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

ProbeError

Startup probe error: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

Unhealthy

Startup probe failed: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

Unhealthy

Readiness probe failed: Get "http://10.134.1.16:15021/healthz/ready": read tcp 10.134.0.2:49258->10.134.1.16:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

ProbeError

Readiness probe error: Get "http://10.134.1.16:15021/healthz/ready": read tcp 10.134.0.2:49258->10.134.1.16:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4e261b-865f9944fb-x7fwx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4e261b-69f87b456c-nnbj6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-737f64-openshift-default-6ddddc9965-96wck

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

ProbeError

Startup probe error: Get "http://10.134.1.16:15021/healthz/ready": dial tcp 10.134.1.16:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

Unhealthy

Startup probe failed: Get "http://10.134.1.16:15021/healthz/ready": dial tcp 10.134.1.16:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-737f64-697d98dc6c-7m4sw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-2c719a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-2c719a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7b8a9d-6b6dcd6988-mhqgv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7b8a9d-677d5bf99-q4r4z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-7b8a9d-openshift-default-5bffc5fb8f-vngwv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4e261b-openshift-default-6bf9798c75-r2qhw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-28ca05-5c69bfcf9d-pjj5c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-28ca05-d8ff875bc-dpg78

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-2c719a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-2c719a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w4-28ca05-openshift-default-7567c7697c-vhnhl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b02580-8594797668-jqqgz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b02580-869cfdd8c-fv6zn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-b02580-openshift-default-5b8db95499-ffbft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-849669-f9698874b-mvl59

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-849669-587b744455-f58ql

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-849669-f9698874b-mvl59

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

multus

test-curl-7377-edefe4

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7377-edefe4

Created

Container created

opendatahub

kubelet

test-curl-7377-edefe4

Started

Container started

opendatahub

kubelet

test-curl-7377-edefe4

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7377-edefe4

Killing

Stopping container test-curl-7377-edefe4

opendatahub

multus

test-curl-7377-046df7

AddedInterface

Add eth0 [10.134.1.23/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7377-046df7

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7377-046df7

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.968s (1.968s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7377-046df7

Created

Container created

opendatahub

kubelet

test-curl-7377-046df7

Started

Container started

opendatahub

kubelet

test-curl-7377-046df7

Killing

Stopping container test-curl-7377-046df7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-7kff2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-rjnqr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-7kff2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 10 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-cnpvg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88gr7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-f1b14f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887

SuccessfulCreate

Created pod: e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-f1b14f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

Created

Container created

openshift-ingress

multus

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

AddedInterface

Add eth0 [10.132.1.178/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

Unhealthy

Startup probe failed: Get "http://10.132.1.178:15021/healthz/ready": dial tcp 10.132.1.178:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

ProbeError

Startup probe error: Get "http://10.132.1.178:15021/healthz/ready": dial tcp 10.132.1.178:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tjjd2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 6 to 5
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-849669-openshift-default-694c9cbc97-cklrg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-67e819-openshift-default-5cc7f5fcbf-9l6c5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-67e819-5f49985cdc-rqhrb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bae155-57bd48f8d-hrc7w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bae155-56867f4547-67cxs

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-67e819-5ffb9f9dd4-n94xc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-4f7443-openshift-default-56c5cd574f-x2trf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4f7443-7c58cf7bf5-cj6d5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4f7443-f94dccdc6-26whf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-0c1869-openshift-default-b557b5fc5-r4xgx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-bae155-openshift-default-6c7cd54585-qc5tv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0c1869-84d987ffcb-x577t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0c1869-855c87c69f-8cw82

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-846099-openshift-default-66cbbc5485-cplw8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-846099-6cbbd9db47-wtrn7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-846099-56bff4c798-z7nkv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-2c719a-openshift-default-6c45bc4b9-tmv7w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-87f2e6-84f4bc9795-dldhj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-87f2e6-6fdccfd5c6-bhs77

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-2c719a-75cc487c78-8dbgt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-2c719a-749bfffff5-2fnqx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-87f2e6-openshift-default-59d48f5df9-sff2h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f1b14f-f5b65c94c-vgldq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f1b14f-587988bb5b-x2cqz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-gdlz4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-f1b14f-openshift-default-6cc6bbd887-2zpwq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-f8f132-openshift-default-664fdd74c7-mcjm6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f8f132-76fb9bcd99-s2xkc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f8f132-7fd7bc96cb-zs6nl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-4a92de-5b5ff574dc-gh8tr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-t4w4s

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-4a92de-87c57c4f6-xrm72

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4fff4f-8cc4568d7-28cbs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4fff4f-786458586b-9k7k8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-4a92de-openshift-default-6bd7b58ff9-mrk66

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-4fff4f-openshift-default-79b6965b8f-qkg2h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 5 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-fwdcl
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fwdcl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-2bc4e2-openshift-default-75d485bdf-5p5h2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2bc4e2-5f48589cf4-9mhnx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2bc4e2-6c55d57495-vc2n6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3ccdab-6c7c5658bc-dz4hs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3ccdab-5c54c8dd94-m2hr2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-1d9b1a-69d786c854-5s7wk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-1d9b1a-7d97888b9f-wgvkh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3ccdab-openshift-default-6865b8777c-mntr9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-1d9b1a-openshift-default-59d77cb49c-xw9tw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e43a66-867f557b99-49tmm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e43a66-7fdfdb6458-pllx4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-e43a66-openshift-default-7d59bc8989-kgncv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-j2htj

Killing

Stopping container istio-proxy